User-agent: * Disallow: /cgi-bin/ Disallow: /assets/ Disallow: /submit*.* Disallow: /*.asp Disallow: /*.css Disallow: /thankyou.html Disallow: /spryassets/ Disallow: /captcha/ Disallow: /*error*.*