From GoogleWebmasterHelp - Matt Cutts explains why a page that is disallowed in robots.txt may still appear in Google’s search results.
October 6th, 2009
robots.txt – uncrawled URLs in search results
A complaint heard often is: “I have blocked Google from crawling a page and robots.txt and Google clearly violated that robot.txt by crawling that page because it’s showing up in Google search results anyway.”
From GoogleWebmasterHelp - Matt Cutts explains why a page that is disallowed in robots.txt may still appear in Google’s search results.
You can leave a response, or trackback from your own site.
From GoogleWebmasterHelp - Matt Cutts explains why a page that is disallowed in robots.txt may still appear in Google’s search results.
Posted in 
