Sitemap: https://buffaloresearch.com/sitemap.xml Sitemap: https://buffaloresearch.com/news-sitemap.xml User-agent: * Disallow: /wp-admin/ Allow: /wp-admin/admin-ajax.php User-agent: Amazonbot Disallow: / User-agent: anthropic-ai Disallow: / User-agent: Applebot-Extended Disallow: / User-agent: Bytespider Disallow: / User-agent: CCBot Disallow: / User-agent: ClaudeBot Disallow: / User-agent: FacebookBot Disallow: / User-agent: Google-Extended Disallow: / User-agent: GPTBot Disallow: / User-agent: meta-externalagent Disallow: / User-agent: omgili Disallow: / User-agent: omgilibot Disallow: / User-agent: PerplexityBot Disallow: / User-agent: SentiBot Disallow: / User-agent: sentibot Disallow: / # AI crawlers blocked via Jetpack SEO. User-agent: Claude-Web Disallow: / User-agent: Webzio-Extended Disallow: / # --- Start Bot Traffic Shield v2.1.1 Rules --- # Whitelisted Search Engines (Always Allowed) User-agent: Googlebot Allow: / User-agent: Storebot-Google Allow: / User-agent: Google-InspectionTool Allow: / User-agent: GoogleOther Allow: / User-agent: bingbot Allow: / User-agent: msnbot Allow: / User-agent: BingPreview Allow: / User-agent: adidxbot Allow: / User-agent: Slurp Allow: / User-agent: DuckDuckBot Allow: / User-agent: DuckDuckGo-Favicons-Bot Allow: / User-agent: Baiduspider Allow: / User-agent: YandexBot Allow: / User-agent: YandexImages Allow: / User-agent: YandexMobileBot Allow: / User-agent: Sogou Allow: / User-agent: Exabot Allow: / User-agent: ia_archiver Allow: / User-agent: Applebot Allow: / User-agent: Twitterbot Allow: / User-agent: LinkedInBot Allow: / User-agent: Pinterestbot Allow: / User-agent: facebookexternalhit Allow: / User-agent: WhatsApp Allow: / User-agent: Slackbot Allow: / User-agent: Discordbot Allow: / User-agent: TelegramBot Allow: / User-agent: AhrefsBot Allow: / User-agent: SemrushBot Allow: / User-agent: MJ12bot Allow: / User-agent: DotBot Allow: / User-agent: rogerbot Allow: / User-agent: Screaming Frog Allow: / User-agent: GTmetrix Allow: / User-agent: Pingdom Allow: / User-agent: UptimeRobot Allow: / # Blocked AI Crawlers & Scrapers User-agent: GPTBot Disallow: / User-agent: ChatGPT-User Disallow: / User-agent: ClaudeBot Disallow: / User-agent: anthropic-ai Disallow: / User-agent: Claude-Web Disallow: / User-agent: Google-Extended Disallow: / User-agent: PerplexityBot Disallow: / User-agent: Bytespider Disallow: / User-agent: FacebookBot Disallow: / User-agent: Meta-ExternalAgent Disallow: / User-agent: Applebot-Extended Disallow: / User-agent: CCBot Disallow: / User-agent: cohere-ai Disallow: / User-agent: Amazonbot Disallow: / User-agent: Diffbot Disallow: / User-agent: Omgilibot Disallow: / User-agent: YouBot Disallow: / User-agent: Timpibot Disallow: / # --- End Bot Traffic Shield Rules ---