# Block ALL bots from specific directories User-agent: * Disallow: /account/ Disallow: /bin/ Disallow: /Code/ Disallow: /Components/ Disallow: /config/ Disallow: /Content/ Disallow: /Controls/ Disallow: /css/ Disallow: /EventFiles/ Disallow: /EventResultFiles/ Disallow: /fonts/ Disallow: /images/ Disallow: /js/ Disallow: /Manage/ Disallow: /Scripts/ Disallow: /Styles/ # Block bots User-agent: AhrefsBot Disallow: / User-agent: Barkrowler Disallow: / User-agent: BLEXBot Disallow: / User-agent: BW/1.1 Disallow: / User-agent: cognitiveSEO Disallow: / User-agent: DataForSeoBot Disallow: / User-agent: Dalvik/2.1.0 Disallow: / User-agent: Dataprovider Disallow: / User-agent: dotbot Disallow: / User-agent: Dubbotbot Disallow: / User-agent: Go-http-client Disallow: / User-agent: IonCrawl Disallow: / User-agent: ISSCyberRiskCrawler Disallow: / User-agent: Java Disallow: / User-agent: lyticsbot Disallow: / User-agent: MauiBot Disallow: / User-agent: Mozlila Disallow: / User-agent: MJ12bot Disallow: / User-agent: OnCrawl Disallow: / User-agent: Orbbot Disallow: / User-agent: Petalbot Disallow: / User-agent: PowerMapper Disallow: / User-agent: python-requests Disallow: / User-agent: RavenCrawler Disallow: / User-agent: rogerbot Disallow: / User-agent: Scrapy Disallow: / User-agent: Screaming Frog SEO Spider Disallow: / User-agent: SemrushBot Disallow: / User-agent: SiteAuditBot Disallow: / User-agent: SplitSignalBot Disallow: / User-agent: Swiftbot Disallow: / User-agent: wp_is_mobile Disallow: / User-agent: ZoominfoBot Disallow: / # Block AI bots User-agent: Anthropic-ai Disallow: / User-agent: Bytespider Disallow: / User-agent: CCBot Disallow: / User-agent: ChatGPT-User Disallow: / User-agent: FacebookBot Disallow: / User-agent: FriendlyCrawler Disallow: / User-agent: Google-Extended Disallow: / User-agent: GPTBot Disallow: / User-agent: Image2dataset Disallow: / User-agent: ImagesiftBot Disallow: / User-agent: Omgilibot Disallow: /