| Bot | Class | Hits↓ | Pages | Last seen | Trend |
|---|---|---|---|---|---|
ChatGPT-User |
Live | 5,775 | 341 | 8m ago | |
Amazonbot |
Training | 5,142 | 1,826 | 22m ago | |
ClaudeBot |
Training | 1,894 | 1,300 | 2h ago | |
Bytespider |
Training | 1,005 | 428 | 25m ago | |
Meta-ExternalAgent |
Training | 957 | 227 | 10m ago | |
OAI-SearchBot |
Indexing | 645 | 349 | 1h ago | |
PerplexityBot |
Indexing | 637 | 209 | 55m ago | |
Claude-User |
Live | 361 | 83 | 33m ago | |
GPTBot |
Training | 184 | 160 | 20h ago | |
Perplexity-User |
Live | 66 | 33 | 1d ago | |
Google-CloudVertexBot |
Training | 35 | 27 | 2d ago | |
CCBot |
Training | 29 | 17 | 2d ago | |
YouBot |
Indexing | 29 | 28 | 18h ago | |
DuckAssistBot |
Live | 22 | 18 | 1d ago | |
xAI |
Live | 15 | 8 | 3d ago |
Each row is a content brief with measurable demand.
Humans arriving on fibr.ai from AI products (ChatGPT, Claude, Perplexity, Gemini, Grok, Copilot) — the payoff of the bot-crawl funnel above.
| Tool | User sessions↓ | Page views | Landing pages | Trend |
|---|---|---|---|---|
ChatGPT |
64 | 73 | 19 | |
Gemini |
54 | 58 | 6 | |
Claude |
10 | 8 | 5 | |
Perplexity |
2 | 1 | 2 | |
Copilot |
0 | 0 | 0 | |
Grok |
0 | 0 | 0 |
| Page | Sessions↓ | Top surface |
|---|---|---|
| /landing-page | 49 | Gemini |
| /landing-page/saas-landing-pages | 27 | ChatGPT |
| (not set) | 11 | ChatGPT |
| / | 10 | ChatGPT |
| /tools/landing-page-analyzer | 5 | ChatGPT |
| /careers | 4 | ChatGPT |
| /conversion-rate-optimization/cro-case-studies | 3 | Claude |
| /customer-stories/expanding-reach-and-boosting-conversions | 2 | ChatGPT |
| /tools/cro-audit | 2 | ChatGPT |
| /ecommerce | 2 | Claude |
| /ab-testing/a-b-testing-ideas | 1 | ChatGPT |
| /blog/best-web-personalization-examples | 1 | ChatGPT |
| /blog/dynamic-yield-alternatives | 1 | ChatGPT |
| /conversion-rate-optimization/ai-marketing-agencies | 1 | ChatGPT |
| /conversion-rate-optimization/cro-strategy | 1 | ChatGPT |
| /conversion-rate-optimization/form-conversion | 1 | ChatGPT |
| /max | 1 | ChatGPT |
| /pilot/ad-personalization | 1 | ChatGPT |
| /pricing | 1 | ChatGPT |
| /terms-and-conditions | 1 | ChatGPT |
| /tools/ai-bio-generator | 1 | ChatGPT |
| /tools/hook-generator | 1 | ChatGPT |
| /experimentation | 1 | Claude |
| /blog/dynamic-landing-pages-what-are-they-why-do-they-matter | 1 | Gemini |
| /geo/llm-content-optimization-best-practices-2026 | 1 | Gemini |
Pages where the worker served pre-stripped, optimised HTML from the ASSETS binding (no origin fetch). High count = a page bots come back to repeatedly.
| Page | Hits↓ | Bots |
|---|---|---|
| /blog/a-complete-guide-to-digital-experience-platforms-%28dxps%29 | 1 | 1 |
| /glossary/conversion-rate-%28cr%29 | 1 | 1 |
avg / p50 / p95 / p99 of duration_ms for hits with positive latency in the window. Strip-path is sub-millisecond; tail is dominated by origin-fallback fetches.
Daily stripped / (stripped + origin-bot-miss) percentage. A dip means the strip pipeline missed pages bots wanted; a climb means new content rolled out and got picked up.
Top-level path segments grouped — e.g. /pricing/*, /docs/*, /blog/*. The % column is per-family stripped share.
| Family | Total↓ | Stripped | Miss | % |
|---|---|---|---|---|
/faq/* |
4,304 | 0 | 0 | 0.0% |
/blog/* |
2,044 | 1 | 369 | 0.0% |
/ |
1,756 | 0 | 0 | 0.0% |
/glossary/* |
1,598 | 1 | 403 | 0.1% |
/landing-page/* |
1,239 | 0 | 20 | 0.0% |
/conversion-rate-optimization/* |
991 | 0 | 56 | 0.0% |
/ab-testing/* |
978 | 0 | 69 | 0.0% |
/tools/* |
925 | 0 | 10 | 0.0% |
/geo/* |
624 | 0 | 3 | 0.0% |
/pilot/* |
151 | 0 | 5 | 0.0% |
/pricing/* |
135 | 0 | 0 | 0.0% |
/about-us/* |
118 | 0 | 0 | 0.0% |
/whitepaper/* |
114 | 0 | 48 | 0.0% |
/customer-stories/* |
114 | 0 | 40 | 0.0% |
/croagency/* |
100 | 0 | 6 | 0.0% |
/seed-funding/* |
81 | 0 | 0 | 0.0% |
/privacy-policy/* |
71 | 0 | 0 | 0.0% |
/guides/* |
62 | 0 | 11 | 0.0% |
/experimentation/* |
56 | 0 | 0 | 0.0% |
/terms-and-conditions/* |
52 | 0 | 0 | 0.0% |
Geographic spread of AI bot requests — useful for understanding regional indexing and crawl prioritisation.
Network operators (ISPs, cloud providers) sourcing AI bot traffic. AWS, Microsoft, Google dominate when bots run on those clouds.
| AS-organisation | Hits↓ | Bots |
|---|---|---|
| Microsoft Corporation | 4,200 | 3 |
| Amazon Technologies Inc. | 3,083 | 3 |
| Amazon Data Services Northern Virginia | 2,310 | 1 |
| Anthropic, PBC | 1,837 | 1 |
| Microsoft Limited | 1,747 | 4 |
| Meta Platforms Ireland Limited | 927 | 1 |
| Amazon Data Services Singapore | 731 | 1 |
| Microsoft do Brasil Imp. e Com. Software e Video G | 223 | 1 |
| Amazon.com, Inc. | 218 | 2 |
| China Unicom Hebei province network | 170 | 1 |
| Infraly, LLC | 104 | 8 |
| Google LLC | 87 | 3 |
| CHINANET hebei province network | 68 | 1 |
| NextGenWebs, S.L. | 63 | 13 |
| Microsoft Deutschland MCIO GmbH | 47 | 2 |