User-agent: Googlebot Disallow: User-agent: Googlebot-Image Disallow: User-agent: Googlebot-Mobile Disallow: User-agent: AhrefsBot Disallow: / User-agent: DotBot Disallow: / User-agent: MJ12bot Disallow: / User-agent: seoscanners.net Disallow: / User-agent: SEOkicks-Robot Disallow: / User-agent: Nutch Disallow: / User-agent: sentibot Disallow: / User-agent: SEMrushBot Disallow: / User-agent: Job Roboter Spider #http://www.webintegration.at/jobroboter_suchmaschine - to many request Disallow: / User-agent: Slurp Crawl-delay: 100 User-agent: gsa-crawler-www Crawl-delay: 100 User-agent: Yahoo-NewsCrawler Crawl-delay: 100 User-Agent: msnbot Crawl-delay: 100 User-agent: OpenindexSpider Disallow: / User-agent: Openindex Disallow: / User-Agent: * Disallow: /donate: Disallow: /admin: Disallow: /config/ Disallow: /handlers/ Disallow: /includes/ Disallow: /interceptors/ Disallow: /layouts/ Disallow: /logs/ Disallow: /models/ Disallow: /modules/ Disallow: /views/