F
axp · bot insights How AI is reading fibr.ai
live Updated Technical view ↗
Product What AI bots are reading and citing

How AI is reading us right now

AI Training Crawls 9,735 Long-term knowledge accumulation
↑ 16.6%
Unique AI bots 18 /36 Of known AI bots, reading us this period
↓ 5.3%
Pages picked up 1,680 Distinct pages read by AI bots
↓ 1.9%
⚠ Content gaps 270 Pages AI asked for that we don't have
↓ 40.4%
Avg latency 357ms Worker handler avg over the window
—

Bot activity, day by day

Live answers 1,554
Training crawls 9,735
Search indexing 1,171
05001,0001,5002,000 Sep 25Sep 27Sep 30Oct 3Oct 6Oct 8

The AI bot roster

Leaderboard
Bot Class Hits↓ Pages Last seen Trend
A
Amazonbot
Training 3,476 1,703 12m ago
M
Meta-ExternalAgent
Training 3,447 434 11m ago
C
ClaudeBot
Training 1,433 1,284 14m ago
B
Bytespider
Training 944 392 29m ago
C
ChatGPT-User
Live 725 217 5m ago
C
Claude-User
Live 681 184 4m ago
P
PerplexityBot
Indexing 649 304 12m ago
O
OAI-SearchBot
Indexing 476 249 22m ago
C
CCBot
Training 161 145 13h ago
O
OAI-AdsBot
Training 138 58 9d ago
G
GPTBot
Training 99 72 3h ago
D
DuckAssistBot
Live 65 58 13h ago
G
Grok
Live 55 42 13h ago
Y
YouBot
Indexing 46 36 1h ago
G
Google-Extended
Training 20 19 13h ago
Mix
12,460
Total bot hits
Live answers
1,554 · 12.5%
Training crawls
9,735 · 78.1%
Search indexing
1,171 · 9.4%
Other
0 · 0.0%

What AI is reading

Top pages — AI Citations
Page Citations↓ Bots Last cited
/ ↗ 422 4 4m ago
/pricing ↗ 106 2 10h ago
/seed-funding ↗ 39 4 2h ago
/about-us ↗ 31 2 18h ago
/guides/ab-testing/facebook ↗ 29 1 20h ago
/blog/fibr-launches-ai-cro-agents ↗ 19 2 6h ago
/newsroom ↗ 19 3 2d ago
/conversion-rate-optimization/cro-case-studies ↗ 18 2 14h ago
/meta-ad-personalization ↗ 13 2 1d ago
/landing-page/saas-landing-pages ↗ 13 2 2d ago
/agentic-web-personalization-ads-llm ↗ 11 2 18h ago
/pilot/ad-personalization ↗ 10 2 1d ago
/privacy-policy ↗ 10 3 18h ago
/guides/ab-testing/ab-testing-examples ↗ 9 2 1d ago
/max ↗ 9 2 23h ago
/customer-stories/fibr-helps-asian-paints-boost-conversions ↗ 9 2 1d ago
/llm-personalization ↗ 9 3 16h ago
/tools/landing-page-analyzer ↗ 9 3 1d ago
/customer-stories/act-fibernet ↗ 8 2 1d ago
/genesis ↗ 8 2 1d ago
/guides/landing-page/google-ads-landing-page ↗ 8 2 9h ago
/guides/ab-testing ↗ 8 3 1d ago
/customer-stories/livspace ↗ 8 2 1d ago
/ab-testing/ai-ab-testing ↗ 7 1 2d ago
/blog/the-landing-page-puzzle-how-message-match-creates-the-perfect-fit ↗ 7 2 2d ago
/tools/cro-audit ↗ 7 2 19h ago
/geo/best-generative-engine-optimization-brands-for-ai ↗ 7 2 2d ago
/blog ↗ 7 2 4h ago
/tools ↗ 7 2 2d ago
/experimentation ↗ 7 2 2d ago
/guides/landing-page/metrics ↗ 6 3 19h ago
/ab-testing/ab-testing-examples ↗ 6 3 21h ago
/terms-and-conditions ↗ 6 2 2d ago
/dpa ↗ 6 3 4d ago
/faq ↗ 6 2 15h ago
/croagency ↗ 6 2 2d ago
/landing-page/landing-page-statistics ↗ 5 2 7h ago
/guides/ab-testing/ab-testing-sample-size ↗ 5 2 5h ago
/blog/ai-audience-segmentation ↗ 5 2 2d ago
/guides/geo/best-llm-optimization-tools-for-ai-visibility ↗ 5 1 1d ago
/personalization-at-scale-cdp ↗ 5 2 4d ago
/blog/a-b-testing-exampless ↗ 5 2 21h ago
/journey-personalization ↗ 5 3 4d ago
/blog/ai-personalization-guide ↗ 4 2 6d ago
/customer-stories/fibr-helps-nixon-medical-boost-conversions ↗ 4 1 2d ago
/blog/website-optimization-all-you-need-to-know-with-tools-tips-and-examples ↗ 4 2 6d ago
/pritam-roy ↗ 4 2 11h ago
/blog/how-to-create-highly-effective-personalized-landing-pages ↗ 4 3 2d ago
/ab-testing/metrics ↗ 4 2 1d ago
/guides/conversion-rate-optimization/conversion-rate-optimization-experts ↗ 4 2 1d ago
/geo/best-llm-optimization-tools-for-ai-visibility ↗ 4 2 3d ago
/geo/llm-seo-tools ↗ 4 2 6d ago
/blog/adobe-target-alternatives ↗ 4 2 6d ago
/guides/landing-page/landing-page-best-practices ↗ 4 3 2d ago
/partnership-program/agency-program ↗ 4 1 15h ago
/ab-testing/ab-testing-tools ↗ 4 2 6h ago
/customer-stories ↗ 4 2 4d ago
/conversion-rate-optimization/best-practices ↗ 4 3 10d ago
/ab-testing/best-practice ↗ 4 1 23h ago
/conversion-rate-optimization ↗ 4 3 9d ago
/conversion-rate-optimization/seo ↗ 3 2 1d ago
/liv ↗ 3 2 15h ago
/customer-stories/fusemi-boosts-conversions-with-fibr ↗ 3 2 4d ago
/ankur-aj ↗ 3 2 2d ago
/landing-page/landing-page-audit ↗ 3 1 2d ago
/tools/hook-generator ↗ 3 2 3d ago
/blog/an-ultimate-guide-to-website-personalization-for-enhanced-user-experience ↗ 3 1 11h ago
/blog/optimizely-alternatives ↗ 3 2 5d ago
/blog/top-landing-page-personalization-software ↗ 3 2 13h ago
/guides/landing-page/top-landing-page-builders ↗ 3 2 9h ago
/guides/conversion-rate-optimization/10-best-conversion-rate-optimization-companies ↗ 3 2 7h ago
/whitepaper ↗ 3 2 1d ago
/personalize-every-ad ↗ 3 1 9h ago
/blog/top-marketing-intelligence-tools ↗ 3 2 1d ago
/guides/landing-page/a-b-testing ↗ 3 1 2d ago
/guides/geo/llm-content-optimization-best-practices-2026 ↗ 3 3 2d ago
/cookie-policy ↗ 3 2 4d ago
/customer-stories/asianpaints ↗ 3 2 2d ago
/faq/how-much-do-ecommerce-cro-agencies-typically-charge ↗ 3 2 4d ago
/guides/ab-testing/ab-testing-tools ↗ 3 2 2d ago
/ab-testing/best-ab-testing-resources ↗ 3 1 15h ago
/conversion-rate-optimization/form-conversion ↗ 2 2 11d ago
/faq/how-do-i-track-performance-of-meta-ads-landing-pages ↗ 2 1 1d ago
/faq/how-much-does-ai-product-image-generation-cost ↗ 2 1 18h ago
/guides/ab-testing/google-ads-ab-testing ↗ 2 1 4d ago
/landing-page/landing-page-best-practices ↗ 2 2 11d ago
/guides/conversion-rate-optimization/ai-marketing-agencies ↗ 2 1 3d ago
/guides/ab-testing/aa-testing-vs-ab-testing ↗ 2 2 6d ago
/conversion-rate-optimization/ai-marketing-agencies ↗ 2 1 33m ago
/conversion-rate-optimization/cro-for-landing-pages ↗ 2 1 1d ago
/blog/personalization-at-scale-strategies-to-boost-marketing-performance ↗ 2 2 6d ago
/blog/dynamic-yield-alternatives ↗ 2 1 8d ago
/blog/best-web-personalization-examples ↗ 2 1 1d ago
/whitepaper/personalized-landing-pages ↗ 2 2 1d ago
/blog/best-landing-page-tools ↗ 2 1 6d ago
/blog/best-marketing-automation-software ↗ 2 1 21h ago
/landing-page/top-landing-page-builders ↗ 2 2 10d ago
/faq/how-much-do-cro-agencies-typically-charge ↗ 2 1 4d ago
/landing-page/a-b-testing ↗ 2 2 3d ago
/pilot/audience-personalization ↗ 2 1 6d ago
Top pages — AI Training
Page Crawls↓ Bots Last crawled
/ ↗ 264 8 29m ago
/blog ↗ 44 5 6h ago
/seed-funding ↗ 42 4 16h ago
/pricing ↗ 37 7 1d ago
/customer-stories/livspace ↗ 36 3 11h ago
/llm-personalization ↗ 36 7 9h ago
/journey-personalization ↗ 35 6 1d ago
/book-a-demo ↗ 34 6 16h ago
/genesis ↗ 34 6 1d ago
/pilot/audience-personalization ↗ 29 6 1d ago
/agentic-web-personalization-ads-llm ↗ 28 6 1d ago
/tools ↗ 28 5 14h ago
/guides ↗ 27 6 16h ago
/customer-stories/act-fibernet ↗ 26 6 10h ago
/privacy-policy ↗ 26 8 8h ago
/google-ad-quality-score ↗ 25 6 16h ago
/customer-stories ↗ 25 7 1d ago
/about-us ↗ 25 7 6h ago
/personalization-at-scale-cdp ↗ 24 6 1d ago
/dpa ↗ 24 6 1d ago
/faq ↗ 24 6 2h ago
/blog/a-complete-guide-to-digital-experience-platforms-(dxps) ↗ 23 6 1d ago
/blog/personalization-at-scale-strategies-to-boost-marketing-performance ↗ 23 6 11h ago
/max ↗ 23 6 16h ago
/guides/conversion-rate-optimization/cro-process ↗ 23 4 9h ago
/pilot/ad-personalization ↗ 23 6 12h ago
/guides/conversion-rate-optimization/form-conversion ↗ 22 3 9h ago
/terms-and-conditions ↗ 22 6 4h ago
/conversion-rate-optimization ↗ 22 5 1d ago
/conversion-rate-optimization/form-conversion ↗ 21 4 19h ago
/whitepaper ↗ 21 5 16h ago
/landing-page/landing-page-statistics ↗ 21 4 16h ago
/blog/ai-cms-the-complete-2026-guide-for-modern-content-teams ↗ 21 5 1d ago
/ab-testing/ab-testing-tools ↗ 21 6 5h ago
/meta-ad-personalization ↗ 20 5 7h ago
/customer-stories/fibr-helps-asian-paints-boost-conversions ↗ 20 5 10h ago
/blog/the-landing-page-puzzle-how-message-match-creates-the-perfect-fit ↗ 20 4 5h ago
/google-search-ad-personalization ↗ 20 5 16h ago
/cookie-policy ↗ 20 6 2d ago
/hypothesis ↗ 19 3 19h ago
/guides/ab-testing/metrics ↗ 19 4 4h ago
/ab-testing/ab-testing-examples ↗ 19 4 1d ago
/customer-stories/fibr-helps-nixon-medical-boost-conversions ↗ 19 6 1d ago
/guides/conversion-rate-optimization/10-best-conversion-rate-optimization-companies ↗ 19 5 2h ago
/newsroom ↗ 18 4 16h ago
/blog/personalized-web-experience ↗ 18 4 49m ago
/partnership-program/agency-program ↗ 18 3 4h ago
/croagency ↗ 18 4 2d ago
/customer-stories/asianpaints ↗ 17 6 16h ago
/guides/landing-page/optimization ↗ 17 4 6h ago
/blog/your-complete-guide-to-digital-experience-analytics ↗ 17 4 1d ago
/media-kit ↗ 17 4 20h ago
/guides/landing-page/landing-page-best-practices ↗ 16 4 21h ago
/localization-personalization ↗ 16 4 14h ago
/faq/what-is-fibr-ai ↗ 16 4 14h ago
/template-for-reports-2 ↗ 16 3 3h ago
/tools/hook-generator ↗ 16 2 22h ago
/guides/geo/geo-tools ↗ 16 4 8h ago
/guides/conversion-rate-optimization/cro-statistics ↗ 16 3 10h ago
/blog/top-landing-page-personalization-software ↗ 16 3 1d ago
/guides/landing-page/a-b-testing ↗ 16 4 4h ago
/faq/does-fibr-require-developers-or-coding ↗ 16 3 15h ago
/whitepaper/agentic-ai-for-bfsi-marketing ↗ 16 3 9h ago
/guides/ab-testing/a-b-testing-mistakes ↗ 16 4 2h ago
/guides/conversion-rate-optimization/cro-case-studies ↗ 16 3 1d ago
/tools/adaptive-web-experience ↗ 16 3 2h ago
/guides/ab-testing/ai-ab-testing ↗ 15 4 14h ago
/blog/ai-personalization-guide ↗ 15 3 2h ago
/guides/landing-page/google-ads-landing-page ↗ 15 5 20m ago
/guides/conversion-rate-optimization/conversion-rate-formula ↗ 15 3 12h ago
/blog/dxp-vs-cms ↗ 15 3 5h ago
/affiliate-program ↗ 15 3 50m ago
/terms-and-policies ↗ 15 5 16h ago
/faq/how-does-fibr-improve-google-ads-quality-score ↗ 15 4 7h ago
/faq/how-many-variations-should-i-create-in-fibr ↗ 15 2 6h ago
/guides/ab-testing/seo ↗ 15 4 5h ago
/glossary ↗ 15 4 1d ago
/report-testing ↗ 15 3 1d ago
/guides/conversion-rate-optimization/cro-terms ↗ 15 3 1h ago
/guides/geo/llm-optimization ↗ 15 4 1h ago
/guides/conversion-rate-optimization/saas-cro ↗ 15 4 52m ago
/agent-experience-audit ↗ 15 2 4h ago
/experimentation ↗ 15 4 16h ago
/guides/geo/best-generative-engine-optimization-brands-for-ai ↗ 15 4 10h ago
/guides/ab-testing/ab-testing-sample-size ↗ 14 4 10h ago
/blog/digital-customer-experience-strategy-ai-execution ↗ 14 3 10h ago
/fibr-partnership-program-old/affiliate-program ↗ 14 3 2d ago
/guides/conversion-rate-optimization/conversion-copywriting ↗ 14 4 13h ago
/guides/geo/ai-visibility-products-for-geo ↗ 14 4 10h ago
/guides/conversion-rate-optimization/cro-audit ↗ 14 3 1d ago
/blog/real-time-personalization ↗ 14 3 7h ago
/glossary/signal-matched-experience ↗ 14 3 1d ago
/guides/ab-testing/multivariate ↗ 14 4 1d ago
/guides/conversion-rate-optimization/understanding-checkout-conversion ↗ 14 3 1d ago
/glossary/experience-generation ↗ 14 4 12h ago
/personalize-every-ad ↗ 14 3 6h ago
/whitepaper/credit-unions-report ↗ 14 4 1d ago
/faq/how-does-fibr-learn-which-experiences-work ↗ 14 2 2h ago
/guides/landing-page/website-personalization-tools ↗ 14 2 14h ago
/guides/landing-page/google-ads-optimization ↗ 14 4 11m ago

What AI wanted that we don't have

Each row is a content brief with measurable demand.

157 content gaps
⚠ 157 gaps
Pages Live bots couldn't find
⚡ Highest urgency — real users asked, AI couldn't answer
urgent
Daily 404 trend · Live + Search bots
0 200

What AI is converting for fibr.ai

Humans arriving on fibr.ai from AI products (ChatGPT, Claude, Perplexity, Gemini, Grok, Copilot) — the payoff of the bot-crawl funnel above.

LLM Referral Traffic 46 Sessions arriving from an AI product
LLM Platforms referring 3 /6 Of tracked AI surfaces
Pages receiving AI referrals 15 Distinct landing pages
Referral visits by AI surface — over time
ChatGPTPerplexityGemini
035810 Sep 25Sep 27Sep 30Oct 3Oct 6Oct 8
Referral traffic spikes often follow high-citation days — watch for a 1–3 day lag between AI citations and human click-throughs.
Top AI referrers
Tool User sessions↓ Page views Landing pages Trend
C
ChatGPT
43 62 13
P
Perplexity
2 2 2
G
Gemini
1 1 1
C
Claude
0 0 0
C
Copilot
0 0 0
G
Grok
0 0 0

What our strip pipeline is actually serving

Pages where the worker served pre-stripped, optimised HTML from the ASSETS binding (no origin fetch). High count = a page bots come back to repeatedly.

Technical Strip-pipeline and infra signals for ops review

Worker handler latency — percentiles

avg / p50 / p95 / p99 of duration_ms for hits with positive latency in the window. Strip-path is sub-millisecond; tail is dominated by origin-fallback fetches.

Avg 357 ms p50 330 ms p95 685 ms p99 1,101 ms
12,460 samples · 0 ms rows excluded (pre-PR-#5 had no latency)

Strip pipeline coverage, day by day

Daily stripped / (stripped + origin-bot-miss) percentage. A dip means the strip pipeline missed pages bots wanted; a climb means new content rolled out and got picked up.

0%50%100% Sep 25Oct 2Oct 8

Which URL prefixes are well-stripped

Top-level path segments grouped — e.g. /pricing/*, /docs/*, /blog/*. The % column is per-family stripped share.

Family Total↓ Stripped Miss %
/faq/* 2,911 2,801 6 96.2%
/guides/* 2,260 30 2,184 1.3%
/blog/* 1,106 347 79 31.4%
/glossary/* 1,071 849 222 79.3%
/ 803 0 0 0.0%
/conversion-rate-optimization/* 426 343 17 80.5%
/customer-stories/* 333 129 85 38.7%
/ab-testing/* 328 227 24 69.2%
/tools/* 284 189 26 66.5%
/landing-page/* 271 191 8 70.5%
/pricing/* 155 0 0 0.0%
/api/* 125 0 125 0.0%
/geo/* 116 49 0 42.2%
/pilot/* 104 11 0 10.6%
/whitepaper/* 97 25 13 25.8%
/seed-funding/* 86 0 0 0.0%
/croagency/* 84 52 5 61.9%
/about-us/* 76 0 0 0.0%
/@fs/* 51 0 51 0.0%
/llm-personalization/* 49 0 0 0.0%

Where AI is fetching us from

Geographic spread of AI bot requests — useful for understanding regional indexing and crawl prioritisation.

US United States
10,443
SG Singapore
840
CN China
154
IN India
124
NL Netherlands
99
DE Germany
91
MX Mexico
55
AU Australia
54
BE Belgium
50
JP Japan
46
DK Denmark
46
TW Taiwan
43

Top AS-organisations by hits

Network operators (ISPs, cloud providers) sourcing AI bot traffic. AWS, Microsoft, Google dominate when bots run on those clouds.

AS-organisation Hits↓ Bots
Meta Platforms Ireland Limited 3,425 1
Amazon Technologies Inc. 2,263 3
Amazon Data Services Northern Virginia 1,743 3
Anthropic, PBC 1,340 1
Microsoft Limited 929 5
Amazon Data Services Singapore 764 1
Google LLC 608 15
Microsoft Corporation 299 5
Amazon.com, Inc. 164 2
Infraly, LLC 68 8
Beijing Zhonglianlixin Technology Co., Ltd. 67 1
Limestone Networks, Inc. 63 8
UNINET 55 1
Microsoft Deutschland MCIO GmbH 46 3
China Unicom Hebei province network 45 1