# robots.txt, Harry Potter Xperts V2 User-agent: * Disallow: /admin/ User-agent: EmailCollector Disallow: / User-agent: MSIECrawler Disallow: / User-agent: Slurp Crawl-delay: 20