PDA

View Full Version : Google Crawler



budgierless
27-07-2010, 07:44 AM
hi.
Can you tell me what info i can put in the robot.txt file to help the google crawler bypass the warning.php mod, or maybe something to add to the .htaccess file so my sitemap generator can crawl my site without getting blocked by the warning mod.

thanks