# Google User-agent: googlebot Disallow: # Yahoo User-agent: inktomi/slurp Disallow: # MSN User-agent: msnbot Disallow: # AllTheWeb User-agent: FAST-WebCrawler Disallow: # Inktomi User-agent: slurp Disallow: # Teoma User-agent: Teoma_agent1 Disallow: # AltaVista User-agent: Scooter Disallow: # Northern Light User-agent: gulliver Disallow: # Excite User-agent: ArchitextSpider Disallow: # Lycos User-agent: Lycos_Spider_(T-Rex) Disallow: # Infoseek User-agent: UltraSeek Disallow: # Looksmart.com User-agent: MantraAgent Disallow: # w3.validator.org User-agent: W3C-checklink Disallow: User-agent: * Disallow: /