Videos 
Should I block duplicate pages using robots.txt?
Should I block duplicate pages using robots.txt?
Admin » 9am - Apr 9, 2010
Halfdeck from Davis, CA asks: "If Google crawls 1,000 pages/day, Googlebot crawling many dupe content pages may slow...
Rating: 0.0 (0 Votes)
Category: Google Videos
Halfdeck from Davis, CA asks: "If Google crawls 1,000 pages/day, Googlebot crawling many dupe content pages may slow down indexing of a large site. In that scenario, do you recommend blocking dupes using robots.txt or is using META ROBOTS NOINDEX,NOFOLLOW a better alternative?"
Short...
Embed Code
Permalink
