I get a SEO newsletter (I won't say which one as to not offend the owner of this board), and the most recent copy had some interesting things to say about a new development with Robots.txt
Quote:
Did you know as of April 11th there was no longer a need to manually submit your sitemap to search engines. Last fall, the major search engines agreed on a sitemaps format. You can now add a simple line to your robots.txt file and let the engines know where your sitemap document resides on your site.
Just include the following line in your robots.txt file and you should be all set:
Sitemap: http://www.yourdomain.com/sitemap.html
Robots.txt has traditionally been used in a more prohibitive fashion - by telling search engine spiders where not to go on your site. This latest sitemaps implementation of robots.txt however is telling the spiders where TO go.
|
Is this information correct???