User-agent: * Disallow: /API/ Disallow: /dgiapp/ Disallow: /sitecore/ Disallow: /sitecore modules/