WhiteHatSEOMarketing

Latest News

 Google Instant went live on 9/9, read industry experts opinions on how this will affect SEO here, including contributions from White Hat SEO Marketing.  

robots.txt - Whitehat SEO Marketing - Glossary

White Hat SEO Glossary Index


A text file placed in the root folder of a web site which gives specific instructions to a visiting bot. It can be used to control which parts of a web site are craled and indexed. This can be useful to avoid creating duplicate content or to exclude spiders from content which the site owner does not want to be considered by search engines.

Back