User-agent: * Disallow: /* Disallow: *.* Disallow: /archive Disallow: /intranet Disallow: /photos Disallow: /webreports Disallow: /saltweb Disallow: /syllabus Disallow: /index_files Disallow: /aspnet_client