Robots.txt Protocol Enhanced by Big Search Engine Companies
I learned today, via Search Tools, that Microsoft, Yahoo! and Google have agreed to specific extensions to the robots.txt file protocol. All of their search engines will now honor additional directives. More info from Yahoo! and Google.
What is robots.txt some of you may be asking? It is a simple text file you can place on your web site to tell search engine spiders what parts of your site they should index and which they should ignore. It has been around for a long time and these are the first additions to the standard in at least a decade.
Leave a Reply
Details About this Article
This article was written on June 4, 2008 at 09:57am and is categorized under:
There are currently no comments on this article.
Previous article: Building Credibility Even When You Can't Say Anything
Next article: Emitting HTML
Subscribe to All Articles
Contact David
C. David Gammel, CAE President High Context Consulting, LLC 102 W. William Street Salisbury, MD 21801
Phone: 410-742-9088
Fax: 240-536-9147
Email: david@highcontext.com
+1 (410) 742-9088 | david@highcontext.com
Copyright © 2008 High Context Consulting
Privacy Policy: HCC will never share your information with anyone without your permission.