User-agent: * Disallow: /assets/* Disallow: /cgibin/ Disallow: /sitecore/* Disallow: /layouts/* Disallow: /upload/*