# Disallow directories User-agent: * Disallow: /private/ Disallow: /sd/private/ Disallow: /cgi-bin/ # Disallow known harmful web bots User-agent: WebCopier v4.3 Disallow: /