Site updated: 10.06.2004 User-agent: * Disallow: /cgi-bin/ # exclude robots from specified tree Disallow: /scripts/ Disallow: /logs/ Disallow: /admin/ Disallow: /styles/ Disallow: /bin/ Disallow: /etc/