User-agent: * Allow: Disallow: /beta/ Disallow: /dontcrawlme/ Disallow: /*?noneededparama=*