12. Feb. 2009
von
Keine Kommentare
robots.txt for bbpress, what to put in?
I didn't find a robots.txt file for bbpress. There are many crawlers looking for this file first so best to have one in your root folder.The content of my current robots.txt file is now:User-agent: Mediapartners-Google*Disallow:User-agent: *Disallow: /bb-admin/Disallow: /bb-cache/Disallow: /bb-includes/Disallow: /bb-plugins/Disallow:…