User-agent: * Disallow: /cgi-bin Disallow: /images Disallow: /public Disallow: /mdb-database Disallow: /webmail.html