F
axp · bot insights How AI is reading fibr.ai
live Updated Technical view ↗
Product What AI bots are reading and citing

How AI is reading us right now

AI Training Crawls 7,462 Long-term knowledge accumulation
↓ 25.2%
Unique AI bots 18 /36 Of known AI bots, reading us this period
↓ 21.7%
Pages picked up 2,394 Distinct pages read by AI bots
↑ 42.6%
⚠ Content gaps 547 Pages AI asked for that we don't have
↑ 32.4%
Avg latency 380ms Worker handler avg over the window

Bot activity, day by day

Live answers 3,202
Training crawls 7,462
Search indexing 1,306
02505007501,000 Aug 8Aug 10Aug 13Aug 16Aug 19Aug 21

The AI bot roster

Leaderboard
Bot Class Hits Pages Last seen Trend
A
Amazonbot
Training 3,463 2,542 2m ago
C
ChatGPT-User
Live 2,835 435 55m ago
M
Meta-ExternalAgent
Training 892 217 1h ago
C
ClaudeBot
Training 842 603 1h ago
B
Bytespider
Training 769 382 46m ago
G
GPTBot
Training 703 554 1h ago
C
CCBot
Training 465 452 2h ago
C
Claude-SearchBot
Indexing 409 48 51m ago
P
PerplexityBot
Indexing 394 148 1h ago
O
OAI-SearchBot
Indexing 351 228 15m ago
C
Claude-User
Live 338 96 1m ago
A
Applebot-Extended
Training 190 48 1d ago
Y
YouBot
Indexing 152 149 11h ago
G
Google-Extended
Training 121 59 8d ago
D
DuckAssistBot
Live 24 20 4h ago
Mix
11,970
Total bot hits
Live answers
3,202 · 26.8%
Training crawls
7,462 · 62.3%
Search indexing
1,306 · 10.9%
Other
0 · 0.0%

What AI is reading

Top pages — AI Citations
Page Citations Bots Last cited
/ 536 4 1m ago
/landing-page/saas-landing-pages 94 3 6h ago
/pricing 76 2 4h ago
/landing-page/landing-page-best-practices 70 1 1d ago
/geo/best-llm-optimization-tools-for-ai-visibility 68 2 2h ago
/blog/ab-tasty-alternatives 58 2 5h ago
/geo/best-generative-engine-optimization-brands-for-ai 54 2 1h ago
/conversion-rate-optimization/cro-case-studies 54 2 7h ago
/seed-funding 46 2 15h ago
/tools/landing-page-analyzer 43 2 2d ago
/blog/the-landing-page-puzzle-how-message-match-creates-the-perfect-fit 38 2 12h ago
/blog/how-to-create-highly-effective-personalized-landing-pages 36 1 4h ago
/blog/ai-personalization-guide 36 2 4h ago
/blog/adobe-target-alternatives 35 2 4h ago
/blog/the-importance-of-a-b-testing-for-landing-page-optimization 35 1 11h ago
/ab-testing/google-ads-ab-testing 35 3 10h ago
/ab-testing/ab-testing-examples 34 3 4h ago
/conversion-rate-optimization/conversion-rate-optimization-experts 26 2 6h ago
/about-us 25 2 1d ago
/blog/top-landing-page-personalization-software 25 1 4h ago
/blog/personalized-web-experience 25 2 4h ago
/geo/llm-seo-tools 25 1 2d ago
/blog/an-ultimate-guide-to-website-personalization-for-enhanced-user-experience 25 1 1d ago
/experimentation 24 2 15h ago
/conversion-rate-optimization/ai-marketing-agencies 23 2 12h ago
/blog/dynamic-landing-pages-what-are-they-why-do-they-matter 23 2 4h ago
/newsroom 22 2 4h ago
/landing-page/landing-page-statistics 21 2 2d ago
/blog 21 2 4h ago
/tools/cro-audit 20 2 22h ago
/blog/real-time-personalization 20 1 4h ago
/tools 20 2 1d ago
/pilot/ad-personalization 20 2 55m ago
/ab-testing/ab-testing-tools 19 1 3h ago
/blog/exploring-dynamic-landing-page-optimization-moving-beyond-a-b-testing 18 2 2d ago
/tools/hook-generator 18 1 2d ago
/tools/landing-page-cro-software 17 1 2d ago
/blog/best-web-personalization-examples 17 2 4h ago
/landing-page/a-b-testing 16 1 4h ago
/blog/website-personalization-strategies 16 1 12h ago
/blog/ai-in-digital-marketing-the-comprehensive-guide 16 1 4h ago
/blog/website-optimization-all-you-need-to-know-with-tools-tips-and-examples 15 1 4h ago
/geo/llm-content-optimization-best-practices-2026 15 3 4h ago
/blog/landing-page-optimization-tools 15 1 4h ago
/ab-testing/ai-ab-testing 14 2 1d ago
/tools/ai-bio-generator 14 2 21h ago
/landing-page/ai 14 1 3d ago
/landing-page/high-converting-landing-page-examples 13 1 1d ago
/blog/personalizing-paid-landing-pages-a-game-changing-strategy-to-reduce-cost-per-lead 12 1 2d ago
/blog/personalization-at-scale-strategies-to-boost-marketing-performance 12 1 4h ago
/google-search-ad-personalization 12 1 2d ago
/conversion-rate-optimization/10-best-conversion-rate-optimization-companies 12 1 2d ago
/blog/best-shopify-landing-page-builders 11 1 1d ago
/blog/top-marketing-intelligence-tools 11 1 1h ago
/agentic-web-personalization-ads-llm 11 1 1d ago
/conversion-rate-optimization 11 2 1d ago
/faq/how-much-does-ai-product-image-generation-cost 10 1 2h ago
/guides/cro 10 2 4h ago
/faq/what-are-the-best-cxl-courses-for-conversion-rate-optimization 10 1 2d ago
/faq/how-long-does-it-take-to-generate-a-product-image-using-ai 10 1 3h ago
/landing-page/checklist 10 1 2d ago
/ab-testing/a-b-testing-ideas 10 1 2d ago
/landing-page/website-personalization-tools 10 1 4h ago
/blog/digital-customer-experience-strategy-ai-execution 10 1 4h ago
/blog/vwo-vs-optimizely 9 1 1d ago
/guides/ab-testing 9 1 4h ago
/max 9 2 3d ago
/terms-and-conditions 9 2 4h ago
/landing-page 9 1 23h ago
/conversion-rate-optimization/conversion-copywriting 8 2 2d ago
/ab-testing/saas-a-b-testing 8 2 6d ago
/privacy-policy 8 4 3h ago
/blog/google-optimize-sunset-guide 8 1 2d ago
/landing-page/top-landing-page-builders 8 1 4h ago
/ab-testing 8 2 4d ago
/geo/geo-tools 8 1 3d ago
/glossary/ad-to-landing-page-personalization 8 1 3d ago
/geo/ai-visibility-products-for-geo 8 1 3d ago
/conversion-rate-optimization/conversion-rate-optimization-program 8 1 15h ago
/conversion-rate-optimization/mobile 8 2 1d ago
/conversion-rate-optimization/cro-for-landing-pages 8 1 12h ago
/ab-testing/ecommerce-a-b-testing 7 1 2d ago
/customer-stories/drinkprime 7 1 4h ago
/conversion-rate-optimization/saas-cro 7 2 2d ago
/landing-page/benefits 7 1 12h ago
/compare/dynamic-yield 7 1 15h ago
/ankur-aj 7 2 4h ago
/liv 7 2 12h ago
/journey-personalization 7 1 4h ago
/conversion-rate-optimization/b2b-conversion-rate-optimization 7 1 2h ago
/llm-personalization 7 1 2d ago
/ecommerce 7 1 12h ago
/landing-page/landing-page-audit 7 2 1d ago
/pilot 6 2 2d ago
/ab-testing/aa-testing-vs-ab-testing 6 2 5d ago
/landing-page/mistakes 6 2 6h ago
/ab-testing/facebook 6 2 2d ago
/pilot/ab-testing 6 2 3d ago
/bfsi-martech-report 6 1 1d ago
/glossary 6 1 4h ago
Top pages — AI Training
Page Crawls Bots Last crawled
/ 458 9 1h ago
/pricing 46 6 4h ago
/blog 41 5 8h ago
/llm-personalization 18 5 3h ago
/agentic-web-personalization-ads-llm 18 5 15h ago
/seed-funding 17 5 8h ago
/landing-page/landing-page-statistics 16 3 2h ago
/experimentation 15 6 1h ago
/newsroom 15 4 17h ago
/genesis 15 5 5h ago
/blog/a-complete-guide-to-digital-experience-platforms-(dxps) 14 4 4h ago
/blog/digital-customer-experience-strategy-ai-execution 13 5 9h ago
/tools 13 5 16h ago
/faq/what-is-fibr-ai 13 3 23h ago
/personalize-every-ad 13 3 11h ago
/whitepaper/agentic-ai-for-bfsi-marketing 13 5 1d ago
/blog/personalization-at-scale-strategies-to-boost-marketing-performance 12 3 6h ago
/blog/personalized-web-experience 12 4 12h ago
/journey-personalization 12 5 1d ago
/blog/ai-audience-segmentation 12 3 18h ago
/glossary/experience-generation 12 5 8h ago
/tools/adaptive-web-experience 12 5 11h ago
/faq/what-results-do-fibr-customers-see 12 4 23h ago
/partnership-program/agency-program 12 5 17h ago
/blog/digital-customer-experience 12 4 11h ago
/blog/the-landing-page-puzzle-how-message-match-creates-the-perfect-fit 12 4 1d ago
/blog/a-b-testing-exampless 11 4 15h ago
/glossary/revenue-per-session 11 4 22h ago
/blog/dynamic-yield-alternatives 11 4 18h ago
/blog/how-to-create-highly-effective-personalized-landing-pages 11 6 3h ago
/blog/adobe-target-alternatives 11 4 1d ago
/customer-stories/drinkprime 11 5 5h ago
/glossary/google-ads-quality-score 11 4 22h ago
/agent-experience-audit 11 3 2h ago
/faq/what-if-fibr-generates-something-off-brand 11 3 7h ago
/glossary/post-click-gap 11 4 9h ago
/manifesto 11 3 7h ago
/blog/digital-transformation-customer-experience 10 3 1h ago
/faq/what-s-the-difference-between-fibr-and-landing-page-builders 10 3 1d ago
/terms-and-conditions 10 4 17h ago
/credit-unions-report-a1 10 3 6h ago
/pilot/ab-testing 10 4 1d ago
/faq/what-s-revenue-per-session-and-why-does-it-matter 10 2 2h ago
/glossary/variant-generation-vs-variant-selection 10 4 1d ago
/glossary/signal-matched-experience 10 4 16h ago
/blog/dxp-vs-cms 10 5 22h ago
/faq/is-fibr-gdpr-and-privacy-compliant 10 4 22h ago
/faq/does-fibr-require-developers-or-coding 10 4 19h ago
/landing-page/metrics 10 3 8h ago
/geo-1 10 4 1h ago
/glossary/message-match-definition 10 4 19h ago
/glossary/referring-url-personalization 10 4 1d ago
/about-us 10 5 1d ago
/max 10 5 46m ago
/faq/how-quickly-can-i-see-results 10 4 22h ago
/croagency 10 5 14h ago
/blog/content-management-system-types-examples 10 3 10h ago
/glossary/llm-traffic-personalization 10 4 23h ago
/customer-stories/fusemi-boosts-conversions-with-fibr 10 5 1d ago
/faq/how-does-fibr-work-with-my-cdp-or-personalization-platform 10 4 10h ago
/geo/ai-visibility-products-for-geo 10 2 4d ago
/fibr-partnership-program-old/affiliate-program 10 3 21h ago
/glossary/agentic-url 9 3 14h ago
/bfsi-martech-report 9 4 2h ago
/glossary/customer-acquisition-cost 9 5 1d ago
/geo/llm-seo-tools 9 4 1d ago
/faq/should-i-stop-a-b-testing-with-fibr 9 3 18h ago
/faq/does-fibr-work-with-single-page-applications-(spas) 9 2 19h ago
/landing-page/structure 9 4 2d ago
/partnership-program 9 3 16h ago
/conversion-rate-optimization-1 9 3 1d ago
/customer-stories/devx 9 4 22h ago
/glossary/location-based-personalization 9 4 2d ago
/conversion-rate-optimization/cro-case-studies 9 4 1d ago
/agentic-experience-event 9 2 16h ago
/landing-page/optimization-tools 9 3 16h ago
/customer-stories/american-express 9 4 21h ago
/faq/how-does-fibr-improve-google-ads-quality-score 9 2 20h ago
/faq/how-many-variations-should-i-create-in-fibr 9 3 1d ago
/agentic-experience 9 2 14h ago
/google-ad-quality-score 9 6 10h ago
/faq/how-does-fibr-generate-experiences-so-quickly 9 2 1h ago
/cmo 9 4 17h ago
/blog/how-to-create-a-winning-omnichannel-landing-page-strategy-in-2023 9 4 9h ago
/personalization-at-scale-cdp 9 5 1d ago
/whitepaper 9 6 16h ago
/glossary/geo-targeting 9 3 6h ago
/glossary/ad-to-landing-page-personalization 9 4 18h ago
/localization-personalization 9 3 22h ago
/hypothesis 9 2 4h ago
/whitepaper/credit-unions-report 9 4 2d ago
/blog/ai-personalization-guide 9 3 17h ago
/blog/boost-ad-efficiency-with-fibr 9 5 21h ago
/blog/top-landing-page-personalization-software 9 5 2d ago
/faq/how-does-fibr-learn-which-experiences-work 9 3 22h ago
/faq/how-is-fibr-different-from-vwo-and-optimizely 9 3 10h ago
/blog/real-time-personalization 9 4 5h ago
/customer-stories/act-fibernet 8 3 2d ago
/faq/what-visitor-signals-does-fibr-detect 8 3 1d ago
/blog/website-optimization-mistakes 8 4 2d ago

What AI wanted that we don't have

Each row is a content brief with measurable demand.

288 content gaps
⚠ 288 gaps
Pages Live bots couldn't find
⚡ Highest urgency — real users asked, AI couldn't answer
urgent
Pages Search bots couldn't find
Indexing crawlers — pages AI products will look for later
Daily 404 trend · Live + Search bots
0 200

What AI is converting for fibr.ai

Humans arriving on fibr.ai from AI products (ChatGPT, Claude, Perplexity, Gemini, Grok, Copilot) — the payoff of the bot-crawl funnel above.

LLM Referral Traffic 112 Sessions arriving from an AI product
LLM Platforms referring 4 /6 Of tracked AI surfaces
Pages receiving AI referrals 23 Distinct landing pages
Referral visits by AI surface — over time
ChatGPTGeminiClaudePerplexity
035810 Aug 8Aug 10Aug 13Aug 16Aug 19Aug 21
Referral traffic spikes often follow high-citation days — watch for a 1–3 day lag between AI citations and human click-throughs.
Top AI referrers
Tool User sessions Page views Landing pages Trend
C
ChatGPT
58 136 17
G
Gemini
41 48 3
C
Claude
8 8 5
P
Perplexity
5 6 2
C
Copilot
0 0 0
G
Grok
0 0 0

What our strip pipeline is actually serving

Pages where the worker served pre-stripped, optimised HTML from the ASSETS binding (no origin fetch). High count = a page bots come back to repeatedly.

Technical Strip-pipeline and infra signals for ops review

Worker handler latency — percentiles

avg / p50 / p95 / p99 of duration_ms for hits with positive latency in the window. Strip-path is sub-millisecond; tail is dominated by origin-fallback fetches.

Avg 380 ms p50 305 ms p95 792 ms p99 1,172 ms
11,970 samples · 0 ms rows excluded (pre-PR-#5 had no latency)

Strip pipeline coverage, day by day

Daily stripped / (stripped + origin-bot-miss) percentage. A dip means the strip pipeline missed pages bots wanted; a climb means new content rolled out and got picked up.

0%50%100% Aug 8Aug 15Aug 21

Which URL prefixes are well-stripped

Top-level path segments grouped — e.g. /pricing/*, /docs/*, /blog/*. The % column is per-family stripped share.

Family Total Stripped Miss %
/faq/* 2,318 0 0 0.0%
/blog/* 1,554 3 358 0.2%
/glossary/* 1,485 1 940 0.1%
/ 1,127 0 0 0.0%
/conversion-rate-optimization/* 515 0 25 0.0%
/landing-page/* 505 0 10 0.0%
/ab-testing/* 394 0 21 0.0%
/tools/* 320 0 15 0.0%
/api/* 297 0 297 0.0%
/geo/* 275 0 2 0.0%
/@fs/* 216 0 216 0.0%
/customer-stories/* 157 0 93 0.0%
/.ssh/* 150 0 150 0.0%
/pricing/* 130 0 0 0.0%
/croagency/* 106 0 49 0.0%
/pilot/* 87 0 2 0.0%
/seed-funding/* 73 0 0 0.0%
/guides/* 66 0 10 0.0%
/whitepaper/* 65 0 23 0.0%
/actuator/* 63 0 63 0.0%

Where AI is fetching us from

Geographic spread of AI bot requests — useful for understanding regional indexing and crawl prioritisation.

US United States
8,474
SG Singapore
719
IN India
623
BE Belgium
459
NL Netherlands
234
CN China
202
CH Switzerland
136
AU Australia
132
PL Poland
132
MY Malaysia
120
DE Germany
102
ES Spain
92

Top AS-organisations by hits

Network operators (ISPs, cloud providers) sourcing AI bot traffic. AWS, Microsoft, Google dominate when bots run on those clouds.

AS-organisation Hits Bots
Google LLC 2,096 10
Amazon Data Services Northern Virginia 1,886 2
Microsoft Limited 1,788 4
Amazon Technologies Inc. 1,675 3
Microsoft Corporation 1,034 5
Meta Platforms Ireland Limited 891 1
Anthropic, PBC 632 1
Amazon Data Services Singapore 567 1
Cloudflare, Inc. 291 2
You.com 152 1
China Unicom Hebei province network 140 1
Amazon.com, Inc. 133 2
Nivid Telecom India Private Limited 74 5
ColoCrossing 67 7
CHINANET hebei province network 61 1