User-Agent: * Allow: / Disallow: /2008-site/ Disallow: /administrator/ Disallow: /cache/ Disallow: /cmsguide/ Disallow: /components/ Disallow: /controlpanel/ Disallow: /css/ Disallow: /images/ Disallow: /includes/ Disallow: /installation/ Disallow: /language/ Disallow: /libraries/ Disallow: /logs/ Disallow: /media/ Disallow: /modules/ Disallow: /payment/ Disallow: /payments/ Disallow: /plesk-stat/ Disallow: /plugins/ Disallow: /templates/ Disallow: /tmp/ Disallow: /xmlrpc/ Disallow: /votedb/ #START AGENT SPECIFIC DISALLOWS User-agent: Abacho Disallow: / User-agent: acontbot Disallow: / User-agent: ah-ha Disallow: / User-agent: AIBOT Disallow: / User-agent: aipbot Disallow: / User-agent: Amfibibot Disallow: / User-agent: AnswerBus Disallow: / User-agent: appie Disallow: / User-agent: Arachmo Disallow: / User-agent: Arameda Disallow: / User-agent: Argus Disallow: / User-agent: Ask Jeeves Disallow: / User-agent: ASPSeek Disallow: / User-agent: asterias Disallow: / User-agent: baiduspider Disallow: / User-agent: BecomeBot Disallow: / User-agent: BigCliqueBOT Disallow: / User-agent: boitho Disallow: / User-agent: Boitho-robot Disallow: / User-agent: BruinBot Disallow: / User-agent: btbot Disallow: / User-agent: bumblebee Disallow: / User-agent: CipinetBot Disallow: / User-agent: citenikbot Disallow: / User-agent: ConveraCrawler Disallow: / User-agent: ConveraMultiMediaCrawler Disallow: / User-agent: cosmos Disallow: / User-agent: CostaCider Disallow: / User-agent: CrawlConvera Disallow: / User-agent: CrawlWave Disallow: / User-agent: CXL-FatAssANT Disallow: / User-agent: DataCha0s Disallow: / User-agent: DataFountains Disallow: / User-agent: Deepindex Disallow: / User-agent: DiamondBot Disallow: / User-agent: DNSGroup Disallow: / User-agent: DTAAgent Disallow: / User-agent: Eule-Robot Disallow: / User-agent: EuripBot Disallow: / User-agent: Euripbot Disallow: / User-agent: eventax Disallow: / User-agent: Exabot Disallow: / User-agent: Exabot Disallow: / User-agent: fantomas Disallow: / User-agent: Faxobot Disallow: / User-agent: FDSE Disallow: / User-agent: FirstGov.gov Search Disallow: / User-agent: fluffy Disallow: / User-agent: FyberSpider Disallow: / User-agent: Gaisbot Disallow: / User-agent: Galaxy Disallow: / User-agent: GalaxyBot Disallow: / User-agent: gazz Disallow: / User-agent: genevabot Disallow: / User-agent: geniebot Disallow: / User-agent: GeoBot Disallow: / User-agent: Girafabot Disallow: / User-agent: GOFORITBOT Disallow: / User-agent: GroschoBot Disallow: / User-agent: gsa-crawler Disallow: / User-agent: holmes Disallow: / User-agent: HooWWWer Disallow: / User-agent: Hotzonu Disallow: / User-agent: htdig Disallow: / User-agent: http://www.btbot.com/btbot.html Disallow: / User-agent: ia_archiver Disallow: / User-agent: ichiro Disallow: / User-agent: IconSurf Disallow: / User-agent: Iltrovatore-Setaccio Disallow: / User-agent: InfociousBot Disallow: / User-agent: INGRID Disallow: / User-agent: INGRID Disallow: / User-agent: InnerpriseBot Disallow: / User-agent: intraVnews Disallow: / User-agent: Jayde Crawler Disallow: / User-agent: LapozzBot Disallow: / User-agent: LocalcomBot Disallow: / User-agent: Lycos Disallow: / User-agent: Mackster Disallow: / User-agent: Matrix Disallow: / User-agent: Metaspinner Disallow: / User-agent: Mirago Disallow: / User-agent: MJ12bot Disallow: / User-agent: Mnogosearch Disallow: / User-agent: MojeekBot Disallow: / User-agent: MonkeyCrawl Disallow: / User-agent: Mozdex Disallow: / User-agent: MSNPTC Disallow: / User-agent: MSRBOT Disallow: / User-agent: NaverBot Disallow: / User-agent: NaverRobot Disallow: / #Old URL's to be blocked out of indexing User-Agent: * Disallow: /featured-projects/ Disallow: /home/ Disallow: /ut/ Disallow: /tfs-reader/ Disallow: /tfs-company-news/ Disallow: /plugins/ Disallow: /featured-news/ Disallow: /plugins/editors/jce/tiny_mce/plugins/advcode/