User-agent: * Disallow: /itshop24/ Disallow: /shop/ Disallow: /temp/ Disallow: *.shtml Disallow: *.php Disallow: /dev/