# Robots.txt file Generic for Frontpage.. # Chris Mendla # Updated Dec 5 2002 # Allow all spiders access to HTTPDOCS and HTTPSDOCS # but block them from the webstat directory User-agent: * Disallow: /httpdocs/webstat/ Disallow: /catalog/ Disallow: /webstat/ Disallow: /flyspeck/ # Note - the t folder was set up to help track google adwords clicks and yahoo # ad clicks. We want to keep the search engines from following it Disallow: /t/