Verified Bot Categories
You can segment your verified bot traffic by its type and purpose by adding the Verified Bot Categories field cf.verified_bot_category as a filter criteria in WAF Custom rules, Advanced Rate Limiting, and Late Transform rules.
- Academic research: Internet Archive, Library of Congress, TurnItInBot
- Accessibility
- Advertising or marketing: Google Adsbot
- Aggregators: Pinterest, Indeed Jobsbot
- AI Crawler: Google Bard, ChatGPT bot
- Feed fetcher: RSS or Podcast feed updaters
- Monitoring or analytics: Uptime Monitors
- Page preview: Facebook, Slack, Twitter, or Discord Link Preview tools
- Search engine crawler: Googlebot, Bingbot, Yandexbot, Baidubot
- Search engine optimization: Google Lighthouse, GT Metrix, Pingdom, AddThis
- Security: Vulnerability Scanners, SSL Domain Control Validation (DCV) Check Tools
- Webhooks: Payment processors, WordPress Integration tools
- Other
Verified Bot Categories is available to all Bots customers.