# Robots.txt file controls where spiders can go # Place at http://www.yoursite.com/robots.txt # # See http://www.robotstxt.org/wc/norobots.html for spec # # Validate any changes to this file at: # http://www.searchengineworld.com/cgi-bin/robotcheck.cgi # Let all spiders go everywhere User-agent: * Disallow: