Bot Detection
AttractOS detects and tracks 40+ AI bots from OpenAI, Anthropic, Google, Meta, and other major AI companies. See which crawlers are indexing your content, how often they visit, and which pages they access most. Bot detection works automatically via both client-side script and server-side Cloudflare integration.
Tracked Bots
AttractOS recognizes the following AI bots and crawlers. The list is continuously updated as new bots emerge.
OpenAI
Anthropic
Microsoft
Perplexity
Meta
Apple
Amazon
xAI
ByteDance
Cohere
Mistral AI
Stability AI
Hugging Face
AI21 Labs
You.com
Brave
DuckDuckGo
Common Crawl
Diffbot
Semrush
Ahrefs
Moz
Majestic
Screaming Frog
Yandex
Baidu
Sogou
Qihoo 360
Neeva
Detection Methods
Client-Side (JavaScript)
The tracking script can detect bots that execute JavaScript. Limited effectiveness since most bots don't run JS.
Partial coverageServer-Side (Cloudflare)
Cloudflare Logpush sends every request's User-Agent to AttractOS, catching all bots regardless of JS support.
RecommendedFor complete bot visibility, we recommend setting up Cloudflare Logpush. This captures bots that block JavaScript execution.
Understanding Bot Data
For each bot visit, AttractOS records:
- Bot name — The identified crawler (e.g., GPTBot, ClaudeBot)
- Company — The organization operating the bot
- Page path — Which page was crawled
- Timestamp — When the crawl occurred
- Country — Geographic origin of the request (via Cloudflare)
Dashboard Metrics
Your dashboard shows:
- Total bot visits — All AI crawler hits in the selected period
- Bot breakdown — Which bots visit most frequently
- Top crawled pages — Your most visited content by AI
- Trends — How bot traffic changes over time
API Access
Query bot data programmatically via the API:
# Get bot breakdown for a site
curl -X GET "https://attractos.com/api/v1/sites/{siteId}/stats?start=2024-01-01&end=2024-01-31" \
-H "Authorization: Bearer YOUR_API_KEY"
# Response includes:
{
"totals": {
"bot_visits": 1847,
...
},
"bot_breakdown": [
{ "bot_name": "GPTBot", "bot_company": "OpenAI", "count": 523 },
{ "bot_name": "ClaudeBot", "bot_company": "Anthropic", "count": 312 },
{ "bot_name": "PerplexityBot", "bot_company": "Perplexity", "count": 289 },
...
]
} Frequently Asked Questions
How does AttractOS detect bots?
What if a bot isn't on this list?
Can I block specific bots while still tracking them?
robots.txt file or server-side rules to block bots. AttractOS will still show you which blocked bots attempted to access your site (via Cloudflare Logpush).