| Bot | Class | Hits↓ | Pages | Last seen | Trend |
|---|---|---|---|---|---|
Amazonbot |
Training | 1,196 | 1,154 | 42m ago | |
ChatGPT-User |
Live | 502 | 172 | 20m ago | |
GPTBot |
Training | 298 | 287 | 2h ago | |
Meta-ExternalAgent |
Training | 247 | 155 | 18m ago | |
Claude-SearchBot |
Indexing | 240 | 47 | 1h ago | |
Bytespider |
Training | 213 | 154 | 1h ago | |
ClaudeBot |
Training | 191 | 122 | 49s ago | |
PerplexityBot |
Indexing | 74 | 45 | 1h ago | |
OAI-SearchBot |
Indexing | 71 | 65 | 55m ago | |
Claude-User |
Live | 62 | 27 | 25m ago | |
YouBot |
Indexing | 34 | 34 | 6m ago | |
DuckAssistBot |
Live | 6 | 5 | 4h ago | |
Applebot-Extended |
Training | 2 | 1 | 1d ago | |
Google-CloudVertexBot |
Training | 1 | 1 | 3h ago | |
CCBot |
Training | 1 | 1 | 3h ago |
Each row is a content brief with measurable demand.
Humans arriving on fibr.ai from AI products (ChatGPT, Claude, Perplexity, Gemini, Grok, Copilot) — the payoff of the bot-crawl funnel above.
| Tool | User sessions↓ | Page views | Landing pages | Trend |
|---|---|---|---|---|
ChatGPT |
21 | 73 | 11 | |
Claude |
3 | 2 | 2 | |
Perplexity |
0 | 0 | 0 | |
Gemini |
0 | 0 | 0 | |
Copilot |
0 | 0 | 0 | |
Grok |
0 | 0 | 0 |
| Page | Sessions↓ | Top surface |
|---|---|---|
| / | 9 | ChatGPT |
| /pilot/ad-personalization | 4 | ChatGPT |
| /book-a-demo | 2 | ChatGPT |
| (not set) | 2 | ChatGPT |
| /blog/personalization-at-scale-strategies-to-boost-marketing-performance | 1 | ChatGPT |
| /blog/top-landing-page-personalization-software | 1 | ChatGPT |
| /faq/what-is-fibr-ai | 1 | ChatGPT |
| /genesis | 1 | ChatGPT |
| /glossary/a-b-n-testing | 1 | ChatGPT |
| /landing-page/saas-landing-pages | 1 | ChatGPT |
| /personalization-at-scale-cdp | 1 | ChatGPT |
Pages where the worker served pre-stripped, optimised HTML from the ASSETS binding (no origin fetch). High count = a page bots come back to repeatedly.
| Page | Hits↓ | Bots |
|---|---|---|
| No stripped hits in window — strip pipeline may not be deployed yet, or no AI bot has hit a stripped page. | ||
avg / p50 / p95 / p99 of duration_ms for hits with positive latency in the window. Strip-path is sub-millisecond; tail is dominated by origin-fallback fetches.
Daily stripped / (stripped + origin-bot-miss) percentage. A dip means the strip pipeline missed pages bots wanted; a climb means new content rolled out and got picked up.
Top-level path segments grouped — e.g. /pricing/*, /docs/*, /blog/*. The % column is per-family stripped share.
| Family | Total↓ | Stripped | Miss | % |
|---|---|---|---|---|
/faq/* |
685 | 0 | 0 | 0.0% |
/glossary/* |
636 | 0 | 457 | 0.0% |
/blog/* |
430 | 0 | 105 | 0.0% |
/ |
142 | 0 | 0 | 0.0% |
/conversion-rate-optimization/* |
119 | 0 | 9 | 0.0% |
/landing-page/* |
115 | 0 | 2 | 0.0% |
/ab-testing/* |
86 | 0 | 4 | 0.0% |
/tools/* |
68 | 0 | 2 | 0.0% |
/geo/* |
62 | 0 | 0 | 0.0% |
/api/* |
58 | 0 | 58 | 0.0% |
/pricing/* |
58 | 0 | 0 | 0.0% |
/customer-stories/* |
49 | 0 | 25 | 0.0% |
/.ssh/* |
48 | 0 | 48 | 0.0% |
/croagency/* |
25 | 0 | 8 | 0.0% |
/pilot/* |
24 | 0 | 1 | 0.0% |
/fibr.ai/* |
20 | 0 | 20 | 0.0% |
/guides/* |
20 | 0 | 2 | 0.0% |
/seed-funding/* |
18 | 0 | 0 | 0.0% |
/whitepaper/* |
17 | 0 | 2 | 0.0% |
/.git/* |
14 | 0 | 14 | 0.0% |
Geographic spread of AI bot requests — useful for understanding regional indexing and crawl prioritisation.
Network operators (ISPs, cloud providers) sourcing AI bot traffic. AWS, Microsoft, Google dominate when bots run on those clouds.
| AS-organisation | Hits↓ | Bots |
|---|---|---|
| Amazon Technologies Inc. | 645 | 2 |
| Amazon Data Services Northern Virginia | 568 | 1 |
| Microsoft Limited | 477 | 3 |
| Cloudflare, Inc. | 286 | 1 |
| Google LLC | 256 | 2 |
| Meta Platforms Ireland Limited | 247 | 1 |
| Amazon Data Services Singapore | 176 | 1 |
| Anthropic, PBC | 114 | 1 |
| Microsoft Corporation | 75 | 2 |
| Nivid Telecom India Private Limited | 56 | 5 |
| Amazon.com, Inc. | 54 | 2 |
| Allnet Broadband Network Pvt Ltd | 35 | 3 |
| You.com | 34 | 1 |
| China Unicom Hebei province network | 29 | 1 |
| MOACK | 14 | 7 |