# Robots File Created: 12th NOV 2004 # Ammended: 19th Jun 2004 - Disallow All Added Except the index file # Ammended: # User Agents: # User-agent: ArchitextSpider #AOL/Excite # User-agent: fast #Fast/AllTheWeb # User-agent: Googlebot #Google # User-agent: Googlebot-Images #Google Images # User-agent: Gulliver #Northern Light # User-agent: ia_archiver #Alexa # User-agent: Lycos_Spider_(T-Rex) #Lycos # User-agent: Scooter #AltaVista # User-agent: Sidewinder #Infoseek # User-agent: Slurp #Inktomi/HotBot # User-agent: WebCrawler #WebCrawler # Robots Known To Have Indexed Arras Resources: # robot # wisenutbot # jeeves # appie # Robots Commands: User-agent: * Disallow: /Maintenance.php Disallow: /My SQL Field List.xls Disallow: /options.php Disallow: /Print Directory Contents.bat Disallow: /robots.txt Disallow: /Site Map - aProfile.vsd Disallow: /welcome.php Disallow: /INC/ Disallow: /images/ Disallow: /CSS/ Disallow: /Menus/ Disallow: /register/ Disallow: /Data From JT - DNU/ Disallow: /login/ Disallow: /Toolz/ Disallow: /members/ Disallow: /CVs/ Disallow: /admin/ Disallow: /Export/ Disallow: /timesheets/ Disallow: /CSV/ Disallow: /Feedback/ esheets/ Disallow: /CSV/ Disallow: /Feedback/ /