#Updated 4-21-2009 #By Bill V. #Open to all search engines #GENERAL (for all bot's) User-agent: * #Disallow: / Disallow: /*vgnextfmt=printer* Disallow: /*.html$ Disallow: /*vgnextoid=ad9b201eb61a7010VgnVCM100000ed730ad1RCRD* Disallow: /*&index=n* Allow: /Cancer/cancer.html #GOOGLE ###User-agent: Googlebot ###Disallow: /ASCO/ #GOOGLE-Image #User-agent: Googlebot-Image #Disallow: /ASCO/ #Mozilla #User-agent: Mozilla #Disallow: /ASCO/ #YAHOO ###User-agent: Slurp ###Disallow: / #MSN #User-agent: msnbot #Disallow: / ###Twiceler ###User-agent: Twiceler ###Disallow: / #GIGABOT ###User-agent: Gigabot ###Disallow: / #YODABOT ###User-agent: Yodabot ###Disallow: / #YODAOBOT ###User-agent: YodaoBot ###Disallow: / #EXABOT ###User-agent: Exabot ###Disallow: / #NAVERBOT ###User-agent: Naverbot ###Disallow: / #InfoPath ###User-agent: InfoPath ###Disallow: / #gsa-crawler User-agent: gsa-crawler Disallow: ###Anansi ###Charlotte ###compatible ###ConveraCrawler ###DiBot ###FAST ###Gaisbot ###gsa-crawler ###ia_archiver ###ia_archiver-web.archive.org ###iMedixBot ###larbin_2.6.3 ###MSR-ISRCCrawler ###nutch ###Speedy+Spider ###T-Mobile ###Ultraseek ###voyager ###W3C-checklink ###WAP_Browser ###WebVac ###yacybot ###YahooFeedSeeker ###Yeti