User-agent: * Disallow: /cronjobshere/ Disallow: /admin/ Disallow: /maintenence/ Disallow: /md5/stuff/ Disallow: /authenticate.php Disallow: /authenticate.php?user=googlebot&pass=googleisgreat&google=google