User-agent: * Disallow: /bin/ Disallow: /web_users/ Disallow: /anon_ftp/ Disallow: /subdomains/ Disallow: /cgi-bin/ Disallow: /private/ Disallow: /error_docs/ Allow: /