User-agent: * Disallow: /admin/ Disallow: /my/ Disallow: /inc/ Disallow: /logs/ # updated 24/02/04