# This directs automatic www robots, crawlers # and mappers to directories they may spider on darkglade.net. User-agent: * Disallow: /images/ Disallow: /logs/ Disallow: /missing.html Disallow: /fobidden.html Disallow: /failed_auth.html Disallow: /internal_error.html Disallow: /stats/ Disallow: /gallery/ Disallow: /mt/ Disallow: /CrappyOldWebsite/ Disallow: /DBProject/ User-agent: vscooter #AltaVista Image Search Disallow: / User-agent: ArribaPacketRat #Arriva Vista Disallow: / User-agent: ExcaliburInternetSpider #Yahoo Image Surfer Disallow: / User-Agent: Googlebot-Image #Googlebot Image Search Disallow: /