# robots.txt file # applies to: current-reports.com, treatment-options.com # rules for all robots User-agent: * Disallow: /*.gif$ Disallow: /*.jpg$ Disallow: /*.pdf$ Disallow: /Dba/ Disallow: /entities/ Disallow: /images/ Disallow: /Java Disallow: /libraries/ Disallow: /OldDba/ Disallow: /pubmed/ Disallow: /robots.txt Disallow: /scheduler/ Disallow: /stats/ Disallow: /verisign_files/ Disallow: /work # rules for Googlebot User-agent: Googlebot Allow: / Disallow: /*.pdf$ # rules for Infotrieve crawler User-agent: infotrieve_crawler Allow: / Disallow: /*.pdf$