Ortwin Oberhauser » robots.txt http://www.ortwin-oberhauser.com Fri, 25 Nov 2011 17:46:57 +0000 en hourly 1 http://wordpress.org/?v=3.1 disallowed in robots.txt http://www.ortwin-oberhauser.com/disallowed-in-robots_txt http://www.ortwin-oberhauser.com/disallowed-in-robots_txt#comments Wed, 07 Oct 2009 09:29:06 +0000 ortwino http://www.oberhauser.at/?p=806 @mattcuttson Twitter. 1. “disallowed in robots.txt]]> Learn more about robots.txt – Often pages that are set on “disallowed in robots.txt” anyway appear in Google’s search results. In the following robots.txt Video Matt Cutts from Google explains why this happens. Follow Matt Cutts >@mattcuttson Twitter.

1. “disallowed in robots.txt

]]> http://www.ortwin-oberhauser.com/disallowed-in-robots_txt/feed 0 robots.txt – uncrawled URLs in search results http://www.ortwin-oberhauser.com/robots-txt-uncrawled-urls-in-search-results http://www.ortwin-oberhauser.com/robots-txt-uncrawled-urls-in-search-results#comments Tue, 06 Oct 2009 07:32:49 +0000 ortwino http://www.ortwin-oberhauser.com/?p=1555
From GoogleWebmasterHelp - Matt Cutts explains why a page that is disallowed in robots.txt may still appear in Google’s search results.

www.youtube.com/watch?v=KBdEwpRQRD0


]]> http://www.ortwin-oberhauser.com/robots-txt-uncrawled-urls-in-search-results/feed 0