# ROBOTS.TXT FOR http://www.marthasvineyard-realestate.com/ # ALL ROBOTS User-agent: * Disallow: /cgi-bin/ # GOOGLE MAY CRAWL EVERYWHERE User-agent: Googlebot User-agent: InfoNaviRobot User-agent: FAST-WebCrawler User-agent: Lycos_Spider User-agent: Atomz User-agent: Scooter User-agent: Slurp Disallow: /searchtools-rss.xml # submitted to google last 2004-05-24 # created 2004-05-24