Crawl-delay: 5 User-agent: * Allow: / User-agent: rogerbot Disallow: / User-agent: WebReaper Disallow: / User-agent: NPBot Disallow: / User-agent: BLEXBot Disallow: /