User-agent: Baiduspider Disallow: / User-agent: MS Search 4.0 Robot Disallow: / User-agent: Nutch Disallow: / User-agent: YandexBot Disallow: / User-agent: MJ12bot Disallow: / #nur alle 30 Sekunden (Yahoo! Slurp, msnbot) User-agent: msnbot Crawl-delay: 30 User-agent: Yahoo! Crawl-delay: 30 User-agent: Slurp Crawl-delay: 30 User-agent: * Disallow: /cms Disallow: /fileadmin Disallow: /rc2 Disallow: /t3lib Disallow: /typo3 Disallow: /typo3* Disallow: /uploads