User-agent: * Disallow: /cgi-bin/ Disallow: /images/ Disallow: /App_Data/ Disallow: /App_GlobalResources/ Disallow: /App_LocalResources/ Disallow: /js/ Disallow: /express/ Disallow: /Email/ Disallow: /help/ Sitemap: http://www.website.com/sitemap.xml # when the site launches generate a sitemap http://www.xml-sitemaps.com/