Can I use robots.txt to optimize Googlebot’s crawl?


Can I use robots.txt to optimize Googlebot’s crawl? For example, can I disallow all but one section of a site (for a week) to ensure it is crawled, and then revert to a ‘normal’ robots.txt? Blind Five Year Old, SF, CA

Author: eWebmaster.us on January 12, 2012
Category: SEO & Internet Marketing
Tags: , , ,

Leave a Reply

Last articles

Get Adobe Flash player

Powered by Yahoo! Answers

SEO Powered by Platinum SEO from Techblissonline

© 1992-2012 DC2NET™, Inc. All Rights Reserved