Bot Appétit the free AEO + SEO readiness check
Scan
Research

Sanity AI readiness statistics

In November 2026, we could only tell which sites run on Sanity where our scanner could read the page, so this page covers those sites and says nothing about how many turned our scanner away.

Updated 04:07 UTC · November 2026

Based on the sites Bot Appétit has scanned. Most of these sites come from lists we scan for research. Not a random sample of the web.

All sites on the State of the Web

How Sanity sites land

Every page we read gets a score out of 100, the number at the top of its report (how scoring works). Each row is a range of scores. Where too few sites score in the lowest ranges, they are joined into one row.

Not enough sites yet There are not enough sites yet to split them by score.

A platform is only detectable on a page our scanner could read, so these shares are of the Sanity sites we could read.

Based on the sites Bot Appétit has scanned. Most of these sites come from lists we scan for research. Not a random sample of the web.

Better or worse

Not enough history yet.

Based on the sites Bot Appétit has scanned. Most of these sites come from lists we scan for research. Not a random sample of the web.

AI access

  • robots.txt disallows some AI crawlers 9%
  • robots.txt disallows major AI crawlers 3%
Show as a table
What we foundShare of sites
robots.txt disallows some AI crawlers9%
robots.txt disallows major AI crawlers3%

Based on the sites Bot Appétit has scanned. Most of these sites come from lists we scan for research. Not a random sample of the web.

What Sanity sites get right and wrong

Passed more often than on the average site: “Semantic HTML landmarks” (76%, against 53% of all sites); “Core security headers are set” (27%, against 12% of all sites); “This page declares its canonical URL” (76%, against 63% of all sites). Least often passed: several checks that no Sanity site we could read passed.

Every check, Sanity against all sites

Share of sites that pass each check, over the sites the check applies to. The Gap column is the difference in percentage points between the two shares; a dash means not enough sites yet.

Check Sanity sites All sites Gap (points)
Served over a secure HTTPS connection 100% >99% Level
HTTP redirects to HTTPS 91% 93% −2 points
No mixed (insecure) content 100% 99% +1 point
Core security headers are set 27% 12% +15 points
Not flagged for malware or phishing 100% 100% Level
No server version leakage 94% 90% +4 points
security.txt is published 15% 4% +11 points
Reached without a redirect chain 97% 98% −1 point
Caching or validation headers are set 85% 94% −9 points
The site settles on one host (www vs non-www) 73% 87% −14 points
robots.txt is present and not over-blocking 88% 88% Level
Not accidentally set to noindex 100% 99% +1 point
This page declares its canonical URL 76% 63% +13 points
Mobile viewport is set 70% 91% −21 points
Has a title tag 94% >99% −6 points
Title fits a search snippet 52% 52% Level
Has a meta description 82% 90% −8 points
Description fits a search snippet — 61% —
The page has an H1 67% 77% −10 points
Logical heading order 61% 62% −1 point
Topic is consistent across title, H1 and description 48% 57% −9 points
Images have descriptive alt text — 90% —
Your page's HTML isn't oversized 100% 98% +2 points
Open Graph tags for sharing 45% 34% +11 points
Twitter/X card tags 73% 69% +4 points
XML sitemap is present and referenced 61% 70% −9 points
Missing pages return a real 404 70% 89% −19 points
Images are optimised — 16% —
Language and charset declared 97% 89% +8 points
hreflang for language variants — 99% —
Analytics is installed 70% 72% −2 points
Search Console / Bing verification 88% 79% +9 points
A favicon is set 97% 95% +2 points
No meta-refresh redirect 100% 99% +1 point
Your content survives without JavaScript 81% 93% −12 points
Your answer is in the HTML 82% 92% −10 points
Buttons, links and fields have names — 37% —
Semantic HTML landmarks 76% 53% +23 points
Content is scannable in self-contained chunks 79% 89% −10 points
Claims come with figures, quotes or sources — 54% —
Section headings are phrased as questions — 22% —
Reading the page is affordable for a machine 73% 87% −14 points
No hidden text written for an AI model 100% >99% Level
Sitemap dates tell a machine what changed — 63% —
The links in llms.txt resolve — 87% —
Author / publisher is clear 48% 47% +1 point
A machine-readable published / updated date 12% 13% −1 point
llms.txt is present and valid 24% 23% +1 point
Clean content for agents (Markdown) 6% 6% Level
Structured data is present 55% 53% +2 points
Structured data is valid — 97% —
FAQ / Q&A schema — 44% —
Organization schema with sameAs 36% 27% +9 points
Right schema type for the page — 85% —
Schema facts also appear in the page text — 54% —
Breadcrumb structured data — 23% —
AI crawlers aren't blocked 82% 89% −7 points
Automated visitors can reach your pages — — —
Engines are allowed to quote the page 100% 99% +1 point
Your page arrives quickly 90% 95% −5 points
AI bot rules are explicit and intentional 15% 16% −1 point
Content usage preferences declared 6% 5% +1 point
Resource-discovery Link headers 3% 1% +2 points
No broken links — 87% —
Links don't point at redirects — 88% —
Descriptive anchor text — 99% —
Sensible internal/external link mix — 94% —
Links are real links — 86% —
Largest Contentful Paint (LCP) — — —
Cumulative Layout Shift (CLS) — — —
Interaction to Next Paint (INP) — — —
Page weight and render-blocking — — —
MCP Server Card 3% 1% +2 points
AI catalog 0% 1% −1 point
A2A Agent Card 0% <1% Level
WebMCP tools in the page 0% 2% −2 points
AI usage preferences (Content-Usage) 0% <1% Level
Licensing terms for AI (RSL) 0% <1% Level
Text-and-data-mining reservation (TDMRep) 0% <1% Level
Markdown version linked from the page 0% 1% −1 point
Content signals agree everywhere — — —
Agent Skills index 0% 1% −1 point
API catalog 0% 1% −1 point
OAuth authorization-server metadata 6% 3% +3 points
OAuth protected-resource metadata 3% 2% +1 point
OpenID Connect discovery 0% 2% −2 points
Web Bot Auth (operates a signed bot) 3% <1% +3 points
Universal Commerce Protocol manifest — 10% —
Auth.md agent registration 3% <1% +3 points
AI discovery via DNS 0% <1% Level

Based on the sites Bot Appétit has scanned. Most of these sites come from lists we scan for research. Not a random sample of the web.

See how your site compares

A free scan checks all of this on your page in seconds, with no signup.

Scan your site free

Want it handled? We do that too. No pitch, just a plain-English chat.

Book a call