| Bot | Class | Hits↓ | Pages | Last seen | Trend |
|---|---|---|---|---|---|
ChatGPT-User |
Live | 2,758 | 263 | 8m ago | |
Amazonbot |
Training | 2,660 | 1,783 | 22m ago | |
Meta-ExternalAgent |
Training | 477 | 168 | 10m ago | |
Bytespider |
Training | 451 | 237 | 25m ago | |
ClaudeBot |
Training | 376 | 259 | 2h ago | |
OAI-SearchBot |
Indexing | 330 | 242 | 1h ago | |
PerplexityBot |
Indexing | 200 | 114 | 55m ago | |
Claude-User |
Live | 185 | 50 | 33m ago | |
GPTBot |
Training | 50 | 36 | 20h ago | |
Perplexity-User |
Live | 33 | 17 | 1d ago | |
Google-CloudVertexBot |
Training | 24 | 19 | 2d ago | |
CCBot |
Training | 22 | 14 | 2d ago | |
DuckAssistBot |
Live | 13 | 13 | 1d ago | |
xAI |
Live | 9 | 6 | 3d ago | |
YouBot |
Indexing | 1 | 1 | 18h ago |
Each row is a content brief with measurable demand.
Humans arriving on fibr.ai from AI products (ChatGPT, Claude, Perplexity, Gemini, Grok, Copilot) — the payoff of the bot-crawl funnel above.
| Tool | User sessions↓ | Page views | Landing pages | Trend |
|---|---|---|---|---|
ChatGPT |
40 | 47 | 12 | |
Gemini |
24 | 26 | 4 | |
Claude |
5 | 6 | 5 | |
Perplexity |
2 | 1 | 2 | |
Copilot |
0 | 0 | 0 | |
Grok |
0 | 0 | 0 |
| Page | Sessions↓ | Top surface |
|---|---|---|
| /landing-page | 21 | Gemini |
| /landing-page/saas-landing-pages | 14 | ChatGPT |
| / | 10 | ChatGPT |
| (not set) | 5 | ChatGPT |
| /tools/landing-page-analyzer | 4 | ChatGPT |
| /careers | 3 | ChatGPT |
| /customer-stories/expanding-reach-and-boosting-conversions | 2 | ChatGPT |
| /tools/cro-audit | 2 | ChatGPT |
| /conversion-rate-optimization/cro-case-studies | 2 | Claude |
| /ab-testing/a-b-testing-ideas | 1 | ChatGPT |
| /conversion-rate-optimization/cro-strategy | 1 | ChatGPT |
| /max | 1 | ChatGPT |
| /pilot/ad-personalization | 1 | ChatGPT |
| /pricing | 1 | ChatGPT |
| /ecommerce | 1 | Claude |
| /experimentation | 1 | Claude |
| /geo/llm-content-optimization-best-practices-2026 | 1 | Gemini |
Pages where the worker served pre-stripped, optimised HTML from the ASSETS binding (no origin fetch). High count = a page bots come back to repeatedly.
| Page | Hits↓ | Bots |
|---|---|---|
| /blog/a-complete-guide-to-digital-experience-platforms-%28dxps%29 | 1 | 1 |
avg / p50 / p95 / p99 of duration_ms for hits with positive latency in the window. Strip-path is sub-millisecond; tail is dominated by origin-fallback fetches.
Daily stripped / (stripped + origin-bot-miss) percentage. A dip means the strip pipeline missed pages bots wanted; a climb means new content rolled out and got picked up.
Top-level path segments grouped — e.g. /pricing/*, /docs/*, /blog/*. The % column is per-family stripped share.
| Family | Total↓ | Stripped | Miss | % |
|---|---|---|---|---|
/faq/* |
1,825 | 0 | 0 | 0.0% |
/blog/* |
951 | 1 | 140 | 0.1% |
/ |
852 | 0 | 0 | 0.0% |
/glossary/* |
606 | 0 | 167 | 0.0% |
/landing-page/* |
570 | 0 | 12 | 0.0% |
/tools/* |
495 | 0 | 6 | 0.0% |
/conversion-rate-optimization/* |
458 | 0 | 31 | 0.0% |
/ab-testing/* |
447 | 0 | 37 | 0.0% |
/geo/* |
272 | 0 | 3 | 0.0% |
/pricing/* |
73 | 0 | 0 | 0.0% |
/whitepaper/* |
72 | 0 | 39 | 0.0% |
/about-us/* |
65 | 0 | 0 | 0.0% |
/pilot/* |
61 | 0 | 4 | 0.0% |
/customer-stories/* |
52 | 0 | 20 | 0.0% |
/croagency/* |
45 | 0 | 3 | 0.0% |
/seed-funding/* |
41 | 0 | 0 | 0.0% |
/guides/* |
36 | 0 | 8 | 0.0% |
/privacy-policy/* |
31 | 0 | 0 | 0.0% |
/terms-and-conditions/* |
24 | 0 | 0 | 0.0% |
/experimentation/* |
23 | 0 | 0 | 0.0% |
Geographic spread of AI bot requests — useful for understanding regional indexing and crawl prioritisation.
Network operators (ISPs, cloud providers) sourcing AI bot traffic. AWS, Microsoft, Google dominate when bots run on those clouds.
| AS-organisation | Hits↓ | Bots |
|---|---|---|
| Microsoft Corporation | 2,162 | 3 |
| Amazon Technologies Inc. | 1,498 | 3 |
| Amazon Data Services Northern Virginia | 1,252 | 1 |
| Microsoft Limited | 750 | 4 |
| Meta Platforms Ireland Limited | 477 | 1 |
| Anthropic, PBC | 359 | 1 |
| Amazon Data Services Singapore | 358 | 1 |
| Microsoft do Brasil Imp. e Com. Software e Video G | 109 | 1 |
| Amazon.com, Inc. | 104 | 1 |
| Infraly, LLC | 80 | 8 |
| China Unicom Hebei province network | 72 | 1 |
| BuyVM | 44 | 7 |
| Google LLC | 38 | 2 |
| CHINANET hebei province network | 21 | 1 |
| Hostodo | 21 | 7 |