User-agent: httrack Disallow: / User-agent: crawlpaper Disallow: / User-agent: webcopy Disallow: / User-agent: webfetcher Disallow: / User-agent: webmirror Disallow: / User-agent: webreader Disallow: / User-agent: webreaper Disallow: / User-agent: curl Disallow: / User-agent: WebZIP Disallow: / User-agent: MSIECrawler Disallow: / User-agent: Wget Disallow: / User-agent: NPBot Disallow: / User-agent: CherryPickerSE Disallow: / User-agent: CherryPickerElite Disallow: / User-agent: Crescent Internet ToolPak HTTP OLE Control v.1.0 Disallow: / User-agent: EmailCollector Disallow: / User-agent: EmailSiphon Disallow: / User-agent: EmailWolf Disallow: / User-agent: ExtractorPro Disallow: / User-agent: WebVulnScan Disallow: / User-agent: SurveyBot Disallow: / User-agent: * Disallow: /cgi-bin/ Disallow: /errordocs/ Disallow: /email-addresses/ Disallow: /cake/