# welcome bots and spiders! # robots.txt for http://www.gem.de/ User-agent: Slurp Crawl-delay: 180 User-agent: * Disallow: /manager/