🦁

Bot Zoo Exhibit Live Menagerie

Classifying AI crawlers, search indexers & scrapers in real-time

Monitoring Active Crawlers
v1.0.4-12
UA

📍 Your Visitor Inspection Booth

Detecting signature...
Your User-Agent String Loading...
Classification Result
Human / Browser
Cage Assignment
Observation Deck
Total Caged Bots
12 Species
Active across 3 tiers
24h Scrape Hits
14,892
+18% vs yesterday
Top Predator
GPTBot / OpenAI
41% of total bandwidth
Defense Status
Exhibits Secure
No breakouts reported

🦁 The Caged Menagerie (Known AI Crawlers & Scrapers)

🤖

GPTBot

OpenAI Crawler
AI Scraper

Forages extensively across public web pages to feed large language models and training corpora.

Danger Level: Medium (Aggressive)
24h Hits: 6,120 requests
User-Agent: GPTBot/1.0
🧠

ClaudeBot

Anthropic Crawler
AI Scraper

Gathers documentation, articles, and code repositories to train Claude models with polite rate limits.

Danger Level: Low (Polite)
24h Hits: 3,840 requests
User-Agent: ClaudeBot/1.0
🔍

Googlebot

Google Indexer
Search Indexer

The veteran apex predator of search engines. Renders JavaScript and catalogs pages for Google Search.

Danger Level: Essential (Beneficial)
24h Hits: 4,210 requests
User-Agent: Googlebot/2.1
⚡

PerplexityBot

Perplexity AI
AI Scraper

Retrieval-augmented generation crawler fetching live web answers for user conversational queries.

Danger Level: Medium
24h Hits: 1,450 requests
User-Agent: PerplexityBot/1.0
🕷️

Bytespider

ByteDance Crawler
AI Scraper

Aggressive scraper associated with TikTok / ByteDance training pipelines. Often ignores robots.txt.

Danger Level: High (Aggressive)
24h Hits: 4,890 requests
User-Agent: Bytespider
🌐

Applebot-Extended

Apple Intelligence
AI / Search

Apple's crawler for powering on-device AI features and Siri intelligence features.

Danger Level: Low
24h Hits: 920 requests
User-Agent: Applebot-Extended

Live Exhibit Incoming Feed

Real-time telemetry stream of incoming requests trapped by the zoo sensor

[13:00:02] SYSTEM: Bot Zoo Exhibit sensor array armed on route '/'
[13:00:15] GPTBot/1.0 GET /pricing AI Scraper (Cage #1)
[13:00:18] Googlebot/2.1 GET /blog/ai-trends Search Indexer (Cage #3)
[13:00:24] Bytespider GET /api/feed Aggressive Scraper (Cage #5)