robots.txt

Name: robots.txt

Object: File

Attributes(s): Static File Name, Customizable File

Summary: The robots.txt file tells search engine crawlers what pages to index and leave out.

More Information

For more information about robots.txt, visit the Robots.txt Notes page at FunBoots.