| Bot | Class | Hits↓ | Pages | Last seen | Trend |
|---|---|---|---|---|---|
Amazonbot |
Training | 3,458 | 2,542 | 42m ago | |
ChatGPT-User |
Live | 2,837 | 435 | 20m ago | |
Meta-ExternalAgent |
Training | 892 | 217 | 18m ago | |
ClaudeBot |
Training | 848 | 607 | 48s ago | |
Bytespider |
Training | 768 | 382 | 1h ago | |
GPTBot |
Training | 703 | 554 | 2h ago | |
CCBot |
Training | 465 | 452 | 3h ago | |
Claude-SearchBot |
Indexing | 409 | 48 | 1h ago | |
PerplexityBot |
Indexing | 394 | 148 | 1h ago | |
OAI-SearchBot |
Indexing | 351 | 228 | 55m ago | |
Claude-User |
Live | 341 | 95 | 25m ago | |
Applebot-Extended |
Training | 190 | 48 | 1d ago | |
YouBot |
Indexing | 153 | 150 | 6m ago | |
Google-Extended |
Training | 121 | 59 | 8d ago | |
DuckAssistBot |
Live | 24 | 20 | 4h ago |
Each row is a content brief with measurable demand.
Humans arriving on fibr.ai from AI products (ChatGPT, Claude, Perplexity, Gemini, Grok, Copilot) — the payoff of the bot-crawl funnel above.
| Tool | User sessions↓ | Page views | Landing pages | Trend |
|---|---|---|---|---|
ChatGPT |
58 | 136 | 17 | |
Gemini |
41 | 48 | 3 | |
Claude |
8 | 8 | 5 | |
Perplexity |
5 | 6 | 2 | |
Copilot |
0 | 0 | 0 | |
Grok |
0 | 0 | 0 |
| Page | Sessions↓ | Top surface |
|---|---|---|
| /landing-page | 39 | Gemini |
| / | 25 | ChatGPT |
| (not set) | 11 | ChatGPT |
| /landing-page/saas-landing-pages | 9 | ChatGPT |
| /pilot/ad-personalization | 6 | ChatGPT |
| /about-us | 2 | ChatGPT |
| /b2b | 2 | ChatGPT |
| /book-a-demo | 2 | ChatGPT |
| /blog | 1 | ChatGPT |
| /blog/personalization-at-scale-strategies-to-boost-marketing-performance | 1 | ChatGPT |
| /blog/top-landing-page-personalization-software | 1 | ChatGPT |
| /faq/what-is-fibr-ai | 1 | ChatGPT |
| /genesis | 1 | ChatGPT |
| /geo/best-generative-engine-optimization-brands-for-ai | 1 | ChatGPT |
| /glossary/a-b-n-testing | 1 | ChatGPT |
| /personalization | 1 | ChatGPT |
| /personalization-at-scale-cdp | 1 | ChatGPT |
| /tools/cro-audit | 1 | ChatGPT |
| /blog/the-landing-page-puzzle-how-message-match-creates-the-perfect-fit | 1 | Claude |
| /conversion-rate-optimization/conversion-rate-optimization-experts | 1 | Claude |
| /conversion-rate-optimization/cro-case-studies | 1 | Claude |
| /tools/landing-page-analyzer | 1 | Gemini |
| /tools/landing-page-cro-software | 1 | Gemini |
Pages where the worker served pre-stripped, optimised HTML from the ASSETS binding (no origin fetch). High count = a page bots come back to repeatedly.
avg / p50 / p95 / p99 of duration_ms for hits with positive latency in the window. Strip-path is sub-millisecond; tail is dominated by origin-fallback fetches.
Daily stripped / (stripped + origin-bot-miss) percentage. A dip means the strip pipeline missed pages bots wanted; a climb means new content rolled out and got picked up.
Top-level path segments grouped — e.g. /pricing/*, /docs/*, /blog/*. The % column is per-family stripped share.
| Family | Total↓ | Stripped | Miss | % |
|---|---|---|---|---|
/faq/* |
2,318 | 0 | 0 | 0.0% |
/blog/* |
1,556 | 3 | 357 | 0.2% |
/glossary/* |
1,484 | 1 | 940 | 0.1% |
/ |
1,126 | 0 | 0 | 0.0% |
/conversion-rate-optimization/* |
514 | 0 | 24 | 0.0% |
/landing-page/* |
505 | 0 | 10 | 0.0% |
/ab-testing/* |
393 | 0 | 21 | 0.0% |
/tools/* |
318 | 0 | 15 | 0.0% |
/api/* |
299 | 0 | 299 | 0.0% |
/geo/* |
276 | 0 | 2 | 0.0% |
/@fs/* |
216 | 0 | 216 | 0.0% |
/customer-stories/* |
157 | 0 | 93 | 0.0% |
/.ssh/* |
150 | 0 | 150 | 0.0% |
/pricing/* |
132 | 0 | 0 | 0.0% |
/croagency/* |
106 | 0 | 49 | 0.0% |
/pilot/* |
87 | 0 | 2 | 0.0% |
/seed-funding/* |
74 | 0 | 0 | 0.0% |
/whitepaper/* |
66 | 0 | 23 | 0.0% |
/guides/* |
66 | 0 | 10 | 0.0% |
/actuator/* |
63 | 0 | 63 | 0.0% |
Geographic spread of AI bot requests — useful for understanding regional indexing and crawl prioritisation.
Network operators (ISPs, cloud providers) sourcing AI bot traffic. AWS, Microsoft, Google dominate when bots run on those clouds.
| AS-organisation | Hits↓ | Bots |
|---|---|---|
| Google LLC | 2,096 | 10 |
| Amazon Data Services Northern Virginia | 1,882 | 2 |
| Microsoft Limited | 1,790 | 4 |
| Amazon Technologies Inc. | 1,675 | 3 |
| Microsoft Corporation | 1,034 | 5 |
| Meta Platforms Ireland Limited | 891 | 1 |
| Anthropic, PBC | 639 | 1 |
| Amazon Data Services Singapore | 566 | 1 |
| Cloudflare, Inc. | 291 | 2 |
| You.com | 153 | 1 |
| China Unicom Hebei province network | 140 | 1 |
| Amazon.com, Inc. | 133 | 2 |
| Nivid Telecom India Private Limited | 74 | 5 |
| ColoCrossing | 67 | 7 |
| CHINANET hebei province network | 61 | 1 |