| Bot | Class | Hits↓ | Pages | Last seen | Trend |
|---|---|---|---|---|---|
Amazonbot |
Training | 7,758 | 1,923 | 11m ago | |
Meta-ExternalAgent |
Training | 4,990 | 610 | 4m ago | |
ClaudeBot |
Training | 3,202 | 1,868 | 5h ago | |
Bytespider |
Training | 2,147 | 692 | 1h ago | |
ChatGPT-User |
Live | 1,738 | 375 | 49m ago | |
PerplexityBot |
Indexing | 1,328 | 398 | 29m ago | |
Claude-User |
Live | 1,316 | 291 | 2m ago | |
OAI-SearchBot |
Indexing | 937 | 395 | 1h ago | |
CCBot |
Training | 604 | 534 | 12h ago | |
GPTBot |
Training | 392 | 250 | 2h ago | |
Grok |
Live | 189 | 96 | 12h ago | |
YouBot |
Indexing | 153 | 104 | 9m ago | |
DuckAssistBot |
Live | 150 | 103 | 12h ago | |
OAI-AdsBot |
Training | 138 | 58 | 9d ago | |
Google-Extended |
Training | 79 | 51 | 12h ago |
Each row is a content brief with measurable demand.
Humans arriving on fibr.ai from AI products (ChatGPT, Claude, Perplexity, Gemini, Grok, Copilot) — the payoff of the bot-crawl funnel above.
| Tool | User sessions↓ | Page views | Landing pages | Trend |
|---|---|---|---|---|
ChatGPT |
96 | 169 | 28 | |
Perplexity |
2 | 2 | 2 | |
Gemini |
1 | 1 | 1 | |
Claude |
0 | 0 | 0 | |
Copilot |
0 | 0 | 0 | |
Grok |
0 | 0 | 0 |
| Page | Sessions↓ | Top surface |
|---|---|---|
| / | 34 | ChatGPT |
| (not set) | 9 | ChatGPT |
| /guides/landing-page/saas-landing-pages | 9 | ChatGPT |
| /pilot/ad-personalization | 6 | ChatGPT |
| /landing-page/saas-landing-pages | 5 | ChatGPT |
| /seed-funding | 5 | ChatGPT |
| /tools/cro-audit | 4 | ChatGPT |
| /dpa | 2 | ChatGPT |
| /newsroom | 2 | ChatGPT |
| /tools/landing-page-analyzer | 2 | ChatGPT |
| /b2b | 1 | ChatGPT |
| /blog/ab-tasty-alternatives | 1 | ChatGPT |
| /blog/ai-personalization-guide | 1 | ChatGPT |
| /blog/an-ultimate-guide-to-website-personalization-for-enhanced-user-experience | 1 | ChatGPT |
| /careers | 1 | ChatGPT |
| /customer-stories/asianpaints | 1 | ChatGPT |
| /customer-stories/livspace | 1 | ChatGPT |
| /experimentation | 1 | ChatGPT |
| /faq/how-does-fibr-ai-s-ai-refine-hypothesis-generation | 1 | ChatGPT |
| /genesis | 1 | ChatGPT |
| /guides/ab-testing/a-b-testing-for-ads | 1 | ChatGPT |
| /guides/landing-page/google-ads-landing-page | 1 | ChatGPT |
| /liv | 1 | ChatGPT |
| /max | 1 | ChatGPT |
| /meta-ad-personalization | 1 | ChatGPT |
Pages where the worker served pre-stripped, optimised HTML from the ASSETS binding (no origin fetch). High count = a page bots come back to repeatedly.
avg / p50 / p95 / p99 of duration_ms for hits with positive latency in the window. Strip-path is sub-millisecond; tail is dominated by origin-fallback fetches.
Daily stripped / (stripped + origin-bot-miss) percentage. A dip means the strip pipeline missed pages bots wanted; a climb means new content rolled out and got picked up.
Top-level path segments grouped — e.g. /pricing/*, /docs/*, /blog/*. The % column is per-family stripped share.
| Family | Total↓ | Stripped | Miss | % |
|---|---|---|---|---|
/faq/* |
6,435 | 3,971 | 75 | 61.7% |
/guides/* |
3,085 | 36 | 2,958 | 1.2% |
/blog/* |
2,474 | 551 | 273 | 22.3% |
/glossary/* |
2,390 | 1,195 | 463 | 50.0% |
/ |
1,744 | 0 | 0 | 0.0% |
/conversion-rate-optimization/* |
883 | 467 | 42 | 52.9% |
/ab-testing/* |
697 | 304 | 81 | 43.6% |
/landing-page/* |
640 | 280 | 16 | 43.8% |
/tools/* |
628 | 268 | 76 | 42.7% |
/customer-stories/* |
577 | 155 | 215 | 26.9% |
/geo/* |
315 | 81 | 0 | 25.7% |
/pricing/* |
307 | 0 | 0 | 0.0% |
/api/* |
302 | 0 | 302 | 0.0% |
/@fs/* |
234 | 0 | 234 | 0.0% |
/croagency/* |
217 | 74 | 52 | 34.1% |
/pilot/* |
193 | 17 | 0 | 8.8% |
/whitepaper/* |
165 | 33 | 35 | 20.0% |
/seed-funding/* |
153 | 0 | 0 | 0.0% |
/about-us/* |
142 | 0 | 0 | 0.0% |
/.ssh/* |
126 | 0 | 126 | 0.0% |
Geographic spread of AI bot requests — useful for understanding regional indexing and crawl prioritisation.
Network operators (ISPs, cloud providers) sourcing AI bot traffic. AWS, Microsoft, Google dominate when bots run on those clouds.
| AS-organisation | Hits↓ | Bots |
|---|---|---|
| Amazon Technologies Inc. | 4,917 | 12 |
| Meta Platforms Ireland Limited | 4,916 | 1 |
| Amazon Data Services Northern Virginia | 4,056 | 7 |
| Anthropic, PBC | 2,975 | 1 |
| Microsoft Limited | 2,142 | 5 |
| Google LLC | 1,882 | 17 |
| Amazon Data Services Singapore | 1,793 | 1 |
| Microsoft Corporation | 497 | 6 |
| Amazon.com, Inc. | 391 | 14 |
| Infraly, LLC | 175 | 8 |
| Limestone Networks, Inc. | 119 | 8 |
| Beijing Zhonglianlixin Technology Co., Ltd. | 109 | 1 |
| You.com | 102 | 1 |
| China Unicom Hebei province network | 83 | 1 |
| CHINANET hebei province network | 78 | 1 |