the free AEO + SEO readiness check How many of the sites we scan let our scanner in, and what they get right and wrong, check by check. Percentages only, refreshed every hour.
Updated 16:07 UTC · November 2026
Based on the sites visitors have scanned with Bot Appétit. Not a random sample of the web.
This group is small, so one site moves a figure by several percentage points. Read each percentage as a handful of sites, not a trend.
Headlines cover all sites, not just the sites visitors scanned. Switch to “All sites” above to see them.
In November 2026, our scanner could read 89% of the sites visitors scanned. The other 11% turned it away.
This is our scanner, not every AI. A site that turns it away may still let other visitors in; how sites treat AI crawlers is in AI access, below.
Every page we read gets a score out of 100, the number at the top of its report (how scoring works). Each row is a range of scores. Where too few sites score in the lowest ranges, they are joined into one row. A site our scanner could not read has no score.
Based on the sites visitors have scanned with Bot Appétit. Not a random sample of the web.
In November 2026, 13% of the sites visitors scanned disallowed some AI crawlers in robots.txt, and 11% turned our scanner away at the server.
These shares are of every site visitors scanned, including the ones that turned our scanner away. The shares in Every check are of the sites we could read, so the same crawler check can read differently there.
Based on the sites visitors have scanned with Bot Appétit. Not a random sample of the web.
Where sites differ covers all sites, not just the sites visitors scanned.
In November 2026, here is where the sites we scanned differ most.
In November 2026, the “OAuth authorization-server metadata” check showed the widest gap between platforms: 89% of Shopify sites passed it, against <1% of Webflow sites.
How sites on each platform treat AI crawlers in robots.txt
A platform is only known for pages our scanner could read, so this table cannot say how many sites on each platform turned our scanner away.
The checks that differ most between platforms, by the share of sites that pass. Each share is over the sites the check applies to.
On Webflow sites the Open Graph check almost always falls short on one tag, og:url, the page's own address: Webflow's page settings have no field for it. The title, description and image are usually there.
In November 2026, 12% of the sites we scanned behind Amazon CloudFront turned our scanner away at the server, and 0% allowed AI crawlers in robots.txt but turned our scanner away anyway.
In November 2026, 11% of the sites visitors scanned turned our scanner away, against 3% of the sites on our research lists.
Lists we scan for research are not a random sample of the web either.
The checks where the two groups differ most, by the share of sites that pass. Each share is over the sites the check applies to.
| Check | Scanned by visitors | Research lists |
|---|---|---|
| Buttons, links and fields have names | 66% | 30% |
| Open Graph tags for sharing | 55% | 20% |
| Analytics is installed | 43% | 77% |
| Images are optimised | 44% | 11% |
| Search Console / Bing verification | 59% | 82% |
| A machine-readable published / updated date | 27% | 9% |
| Links don't point at redirects | 75% | 93% |
| Claims come with figures, quotes or sources | 40% | 56% |
| No broken links | 73% | 88% |
| Semantic HTML landmarks | 64% | 49% |
Based on all the sites Bot Appétit has scanned. Not a random sample of the web.
In November 2026, “Served over a secure HTTPS connection” was the check sites passed most often: 100% of the sites we could read passed it. “llms.txt is present and valid” was the one they failed most often: 63% of the sites we could read failed it.
A dash means not enough sites yet. Each check links to what it is and what good looks like.
Applies to is the share of the sites we could read that the check ran on, because some checks have nothing to judge on many pages.
The other columns are shares of those sites, not of every site. Newer checks only cover sites scanned since the check was added.
“Automated visitors can reach your pages” shows a dash: a site passes it whenever our scanner could read the page, so it only repeats whether we got in. See how many turned us away.
Fixed and Broke compare re-scanned sites, and those columns are left out until there are enough of them. Not enough history yet.
Error:
| Check | Applies to | Result | Pass | Worth a look | To fix | Couldn't judge |
|---|---|---|---|---|---|---|
| Your content survives without JavaScript | Applies to 100% | Pass 86% | Worth a look 2% | To fix 4% | Couldn't judge 8% | |
| Your answer is in the HTML | Applies to 100% | Pass 90% | Worth a look 2% | To fix 7% | Couldn't judge 0% | |
| Semantic HTML landmarks | Applies to 100% | Pass 64% | Worth a look 36% | To fix 0% | Couldn't judge 0% | |
| Content is scannable in self-contained chunks | Applies to 100% | Pass 89% | Worth a look 11% | To fix 0% | Couldn't judge 0% | |
| Author / publisher is clear | Applies to 100% | Pass 61% | Worth a look 39% | To fix 0% | Couldn't judge 0% | |
| A machine-readable published / updated date | Applies to 100% | Pass 27% | Worth a look 73% | To fix 0% | Couldn't judge 0% | |
| llms.txt is present and valid | Applies to 100% | Pass 34% | Worth a look 1% | To fix 63% | Couldn't judge 2% | |
| Clean content for agents (Markdown) | Applies to 100% | Pass 4% | Worth a look 73% | To fix 0% | Couldn't judge 23% |
| Check | Applies to | Result | Pass | Worth a look | To fix | Couldn't judge |
|---|---|---|---|---|---|---|
| Buttons, links and fields have names | Applies to 70% | Pass 66% | Worth a look 31% | To fix 3% | Couldn't judge 0% | |
| AI crawlers aren't blocked | Applies to 100% | Pass 86% | Worth a look 7% | To fix 6% | Couldn't judge 1% | |
| Automated visitors can reach your pages See how many turned us away | Applies to — | Not enough sites yet | Pass — | Worth a look — | To fix — | Couldn't judge — |
| Engines are allowed to quote the page | Applies to 77% | Pass 97% | Worth a look 2% | To fix 2% | Couldn't judge 0% | |
| Your page arrives quickly | Applies to 77% | Pass 92% | Worth a look 6% | To fix 2% | Couldn't judge 0% |
| Check | Applies to | Result | Pass | Worth a look | To fix | Couldn't judge |
|---|---|---|---|---|---|---|
| AI bot rules are explicit and intentional | Applies to 100% | Pass 19% | Worth a look 80% | To fix 0% | Couldn't judge 1% |
| Check | Applies to | Result | Pass | Worth a look | To fix | Couldn't judge |
|---|---|---|---|---|---|---|
| Structured data is present | Applies to 100% | Pass 65% | Worth a look 0% | To fix 35% | Couldn't judge 0% | |
| Structured data is valid | Applies to 64% | Pass 100% | Worth a look 0% | To fix 0% | Couldn't judge 0% | |
| FAQ / Q&A schema | Applies to — | Not enough sites yet | Pass — | Worth a look — | To fix — | Couldn't judge — |
| Organization schema with sameAs | Applies to 100% | Pass 33% | Worth a look 25% | To fix 42% | Couldn't judge 0% | |
| Right schema type for the page | Applies to 64% | Pass 96% | Worth a look 4% | To fix 0% | Couldn't judge 0% | |
| Schema facts also appear in the page text | Applies to — | Not enough sites yet | Pass — | Worth a look — | To fix — | Couldn't judge — |
| Breadcrumb structured data | Applies to — | Not enough sites yet | Pass — | Worth a look — | To fix — | Couldn't judge — |
| Check | Applies to | Result | Pass | Worth a look | To fix | Couldn't judge |
|---|---|---|---|---|---|---|
| Reached without a redirect chain | Applies to 100% | Pass 98% | Worth a look 2% | To fix 0% | Couldn't judge 0% | |
| Caching or validation headers are set | Applies to 100% | Pass 86% | Worth a look 14% | To fix 0% | Couldn't judge 0% | |
| The site settles on one host (www vs non-www) | Applies to 100% | Pass 80% | Worth a look 8% | To fix 6% | Couldn't judge 6% | |
| robots.txt is present and not over-blocking | Applies to 100% | Pass 86% | Worth a look 0% | To fix 14% | Couldn't judge 0% | |
| Not accidentally set to noindex | Applies to 100% | Pass 89% | Worth a look 0% | To fix 11% | Couldn't judge 0% | |
| This page declares its canonical URL | Applies to 100% | Pass 69% | Worth a look 7% | To fix 24% | Couldn't judge 0% | |
| Has a title tag | Applies to 100% | Pass 99% | Worth a look 0% | To fix 1% | Couldn't judge 0% | |
| Has a meta description | Applies to 100% | Pass 78% | Worth a look 7% | To fix 14% | Couldn't judge 0% | |
| The page has an H1 | Applies to 100% | Pass 86% | Worth a look 1% | To fix 13% | Couldn't judge 0% | |
| Logical heading order | Applies to 100% | Pass 69% | Worth a look 23% | To fix 1% | Couldn't judge 7% | |
| Topic is consistent across title, H1 and description | Applies to 100% | Pass 63% | Worth a look 22% | To fix 0% | Couldn't judge 16% | |
| Images have descriptive alt text | Applies to 86% | Pass 92% | Worth a look 8% | To fix 0% | Couldn't judge 0% | |
| Your page's HTML isn't oversized | Applies to 77% | Pass 97% | Worth a look 0% | To fix 3% | Couldn't judge 0% | |
| Open Graph tags for sharing | Applies to 100% | Pass 55% | Worth a look 28% | To fix 17% | Couldn't judge 0% | |
| XML sitemap is present and referenced | Applies to 100% | Pass 65% | Worth a look 12% | To fix 16% | Couldn't judge 7% | |
| Missing pages return a real 404 | Applies to 100% | Pass 90% | Worth a look 0% | To fix 5% | Couldn't judge 5% | |
| Language and charset declared | Applies to 100% | Pass 98% | Worth a look 2% | To fix 0% | Couldn't judge 0% | |
| hreflang for language variants | Applies to — | Not enough sites yet | Pass — | Worth a look — | To fix — | Couldn't judge — |
| No meta-refresh redirect | Applies to 100% | Pass 98% | Worth a look 2% | To fix 0% | Couldn't judge 0% |
| Check | Applies to | Result | Pass | Worth a look | To fix | Couldn't judge |
|---|---|---|---|---|---|---|
| No broken links | Applies to 93% | Pass 73% | Worth a look 6% | To fix 3% | Couldn't judge 18% | |
| Links don't point at redirects | Applies to 87% | Pass 75% | Worth a look 6% | To fix 0% | Couldn't judge 19% | |
| Descriptive anchor text | Applies to 92% | Pass 99% | Worth a look 1% | To fix 0% | Couldn't judge 0% | |
| Links are real links | Applies to 70% | Pass 91% | Worth a look 9% | To fix 0% | Couldn't judge 0% |
Not enough sites yet
| Check | Applies to | Result | Pass | Worth a look | To fix | Couldn't judge |
|---|---|---|---|---|---|---|
| Largest Contentful Paint (LCP) | Applies to — | Not enough sites yet | Pass — | Worth a look — | To fix — | Couldn't judge — |
| Cumulative Layout Shift (CLS) | Applies to — | Not enough sites yet | Pass — | Worth a look — | To fix — | Couldn't judge — |
| Interaction to Next Paint (INP) | Applies to — | Not enough sites yet | Pass — | Worth a look — | To fix — | Couldn't judge — |
| Page weight and render-blocking | Applies to — | Not enough sites yet | Pass — | Worth a look — | To fix — | Couldn't judge — |
| Check | Applies to | Result | Pass | Worth a look | To fix | Couldn't judge |
|---|---|---|---|---|---|---|
| Served over a secure HTTPS connection | Applies to 100% | Pass 100% | Worth a look 0% | To fix 0% | Couldn't judge 0% | |
| HTTP redirects to HTTPS | Applies to 100% | Pass 89% | Worth a look 1% | To fix 7% | Couldn't judge 2% | |
| No mixed (insecure) content | Applies to 100% | Pass 98% | Worth a look 0% | To fix 2% | Couldn't judge 0% | |
| Not flagged for malware or phishing | Applies to 100% | Pass 100% | Worth a look 0% | To fix 0% | Couldn't judge 0% |
| Check | Applies to | Result | Pass | Worth a look | To fix | Couldn't judge |
|---|---|---|---|---|---|---|
| Content usage preferences declared | Applies to 100% | Pass 12% | Worth a look 87% | To fix 0% | Couldn't judge 1% | |
| Resource-discovery Link headers | Applies to 100% | Pass 4% | Worth a look 96% | To fix 0% | Couldn't judge 0% | |
| MCP Server Card | Applies to 100% | Pass 2% | Worth a look 83% | To fix 0% | Couldn't judge 14% | |
| AI catalog | Applies to 100% | Pass 2% | Worth a look 86% | To fix 0% | Couldn't judge 12% | |
| A2A Agent Card | Applies to 77% | Pass 3% | Worth a look 84% | To fix 0% | Couldn't judge 13% | |
| WebMCP tools in the page | Applies to 77% | Pass 2% | Worth a look 98% | To fix 0% | Couldn't judge 0% | |
| AI usage preferences (Content-Usage) | Applies to 77% | Pass 0% | Worth a look 98% | To fix 0% | Couldn't judge 2% | |
| Licensing terms for AI (RSL) | Applies to 77% | Pass 0% | Worth a look 98% | To fix 0% | Couldn't judge 2% | |
| Text-and-data-mining reservation (TDMRep) | Applies to 77% | Pass 0% | Worth a look 84% | To fix 0% | Couldn't judge 16% | |
| Markdown version linked from the page | Applies to 77% | Pass 5% | Worth a look 95% | To fix 0% | Couldn't judge 0% | |
| Content signals agree everywhere | Applies to — | Not enough sites yet | Pass — | Worth a look — | To fix — | Couldn't judge — |
| Agent Skills index | Applies to 100% | Pass 1% | Worth a look 78% | To fix 0% | Couldn't judge 20% | |
| API catalog | Applies to 100% | Pass 2% | Worth a look 77% | To fix 0% | Couldn't judge 20% | |
| OAuth authorization-server metadata | Applies to 100% | Pass 8% | Worth a look 67% | To fix 0% | Couldn't judge 24% | |
| OAuth protected-resource metadata | Applies to 100% | Pass 5% | Worth a look 71% | To fix 0% | Couldn't judge 24% | |
| OpenID Connect discovery | Applies to 100% | Pass 8% | Worth a look 67% | To fix 0% | Couldn't judge 24% | |
| Web Bot Auth (operates a signed bot) | Applies to 100% | Pass 0% | Worth a look 72% | To fix 0% | Couldn't judge 28% | |
| Universal Commerce Protocol manifest | Applies to — | Not enough sites yet | Pass — | Worth a look — | To fix — | Couldn't judge — |
| Auth.md agent registration | Applies to 100% | Pass 1% | Worth a look 71% | To fix 0% | Couldn't judge 28% | |
| AI discovery via DNS | Applies to 100% | Pass 1% | Worth a look 99% | To fix 0% | Couldn't judge 0% |
| Check | Applies to | Result | Pass | Worth a look | To fix | Couldn't judge |
|---|---|---|---|---|---|---|
| Core security headers are set | Applies to 100% | Pass 19% | Worth a look 48% | To fix 33% | Couldn't judge 0% | |
| No server version leakage | Applies to 100% | Pass 88% | Worth a look 12% | To fix 0% | Couldn't judge 0% | |
| security.txt is published | Applies to 100% | Pass 11% | Worth a look 83% | To fix 0% | Couldn't judge 6% | |
| Mobile viewport is set | Applies to 100% | Pass 90% | Worth a look 10% | To fix 0% | Couldn't judge 0% | |
| Title fits a search snippet | Applies to 99% | Pass 59% | Worth a look 41% | To fix 0% | Couldn't judge 0% | |
| Description fits a search snippet | Applies to 66% | Pass 78% | Worth a look 22% | To fix 0% | Couldn't judge 0% | |
| Twitter/X card tags | Applies to 100% | Pass 66% | Worth a look 34% | To fix 0% | Couldn't judge 0% | |
| Images are optimised | Applies to 86% | Pass 44% | Worth a look 56% | To fix 0% | Couldn't judge 0% | |
| Analytics is installed | Applies to 100% | Pass 43% | Worth a look 57% | To fix 0% | Couldn't judge 0% | |
| Search Console / Bing verification | Applies to 100% | Pass 59% | Worth a look 41% | To fix 0% | Couldn't judge 0% | |
| A favicon is set | Applies to 100% | Pass 95% | Worth a look 5% | To fix 0% | Couldn't judge 0% | |
| Claims come with figures, quotes or sources | Applies to 52% | Pass 40% | Worth a look 60% | To fix 0% | Couldn't judge 0% | |
| Section headings are phrased as questions | Applies to 52% | Pass 21% | Worth a look 79% | To fix 0% | Couldn't judge 0% | |
| Reading the page is affordable for a machine | Applies to — | Not enough sites yet | Pass — | Worth a look — | To fix — | Couldn't judge — |
| No hidden text written for an AI model | Applies to — | Not enough sites yet | Pass — | Worth a look — | To fix — | Couldn't judge — |
| Sitemap dates tell a machine what changed | Applies to — | Not enough sites yet | Pass — | Worth a look — | To fix — | Couldn't judge — |
| The links in llms.txt resolve | Applies to — | Not enough sites yet | Pass — | Worth a look — | To fix — | Couldn't judge — |
| Sensible internal/external link mix | Applies to 93% | Pass 92% | Worth a look 8% | To fix 0% | Couldn't judge 0% |
Based on the sites visitors have scanned with Bot Appétit. Not a random sample of the web.
What goes together covers all sites, not just the sites visitors scanned.
In November 2026, these were the pairs of checks that sites tended to pass together.
This is an association between checks, not a cause: passing one does not make a site pass the other. It shows what tends to sit together on a site that has been looked after.
Sites that pass the “Resource-discovery Link headers” check are 24.5 times as likely to pass the “Content usage preferences declared” check too. 69% of the sites that pass the first check pass this one, against 3% of the sites that do not.
Sites that pass the “Resource-discovery Link headers” check are 21.5 times as likely to pass the “Clean content for agents (Markdown)” check too. 72% of the sites that pass the first check pass this one, against 3% of the sites that do not.
Sites that pass the “AI bot rules are explicit and intentional” check are 13 times as likely to pass the “Content usage preferences declared” check too. 19% of the sites that pass the first check pass this one, against 1% of the sites that do not.
Sites that pass the “Clean content for agents (Markdown)” check are 12.5 times as likely to pass the “Content usage preferences declared” check too. 30% of the sites that pass the first check pass this one, against 2% of the sites that do not.
Sites that pass the “Open Graph tags for sharing” check are 10.5 times as likely to pass the “OAuth authorization-server metadata” check too. 10% of the sites that pass the first check pass this one, against 1% of the sites that do not.
Sites that pass the “A machine-readable published / updated date” check are 9.5 times as likely to pass the “Resource-discovery Link headers” check too. 7% of the sites that pass the first check pass this one, against 1% of the sites that do not.
Sites that pass the “Core security headers are set” check are 9 times as likely to pass the “security.txt is published” check too. 25% of the sites that pass the first check pass this one, against 3% of the sites that do not.
Sites that pass the “AI bot rules are explicit and intentional” check are 7.5 times as likely to pass the “Resource-discovery Link headers” check too. 6% of the sites that pass the first check pass this one, against 1% of the sites that do not.
Sites that pass the “llms.txt is present and valid” check are 7.5 times as likely to pass the “Clean content for agents (Markdown)” check too. 11% of the sites that pass the first check pass this one, against 1% of the sites that do not.
Sites that pass the “llms.txt is present and valid” check are 7 times as likely to pass the “Content usage preferences declared” check too. 10% of the sites that pass the first check pass this one, against 1% of the sites that do not.
Based on all the sites Bot Appétit has scanned. Not a random sample of the web.
In November 2026, here is how the sites we could read did in each category we score.
Advanced and Good practice are on every report but do not count towards the score, so they are marked not scored.
Of the AEO / content results, 57% are passes, 30% are worth a look and 9% need fixing.
Of the AI access results, 86% are passes, 11% are worth a look and 3% need fixing.
Of the AI signals results, 19% are passes, 80% are worth a look and 0% need fixing.
Of the Structured data results, 64% are passes, 16% are worth a look and 20% need fixing.
Of the SEO results, 83% are passes, 8% are worth a look and 7% need fixing.
Of the Links results, 84% are passes, 5% are worth a look and 1% need fixing.
Of the Security results, 97% are passes, <1% are worth a look and 2% need fixing.
Of the Advanced results, 3% are passes, 83% are worth a look and 0% need fixing.
Of the Good practice results, 59% are passes, 38% are worth a look and 3% need fixing.
Based on the sites visitors have scanned with Bot Appétit. Not a random sample of the web.
In November 2026, the most common type of structured data was WebSite, on 48% of the sites we could read.
Each type is counted as the type a page publishes in its own right, not when it sits nested inside other markup. The “Organization schema with sameAs” check also counts subtypes and nested markup, so its figure in Every check is a different count. See Every check.
Based on the sites visitors have scanned with Bot Appétit. Not a random sample of the web.
In November 2026, “llms.txt is present and valid” was the emerging standard that sites passed most often: 34% of the sites we could read passed it.
Based on the sites visitors have scanned with Bot Appétit. Not a random sample of the web.
Change over time covers all sites, not just the sites visitors scanned.
These lines count the sites scanned in each calendar month, so a month's figure can differ from the headline figures above, which use each site's latest scan from the last three months. The “All sites” column is every site scanned that month, including sites added since, so a change there can be a different crowd being scanned.
“Same sites” is every month for the one group of sites scanned in both the first month with a figure and the latest month, so a change there is the sites themselves changing.
Counting every site scanned in November 2026, 7% of the sites we could read passed the “Agent Skills index” check. On the sites scanned in both October 2026 and November 2026, the share went from 9% to 8%.
Line: Same sites Line: All sites (new ones included)
| Month | Applies to | All sites (new ones included) | Same sites |
|---|---|---|---|
| October 2026 | 100% | 1% | 9% |
| November 2026 | 100% | 7% | 8% |
Counting every site scanned in November 2026, 7% of the sites we could read passed the “API catalog” check. On the sites scanned in both October 2026 and November 2026, the share stayed at 7%.
Line: Same sites Line: All sites (new ones included)
| Month | Applies to | All sites (new ones included) | Same sites |
|---|---|---|---|
| October 2026 | 100% | 1% | 7% |
| November 2026 | 100% | 7% | 7% |
Counting every site scanned in November 2026, 5% of the sites we could read passed the “Auth.md agent registration” check. On the sites scanned in both October 2026 and November 2026, the share stayed at 5%.
Line: Same sites Line: All sites (new ones included)
| Month | Applies to | All sites (new ones included) | Same sites |
|---|---|---|---|
| October 2026 | 100% | <1% | 5% |
| November 2026 | 100% | 5% | 5% |
Counting every site scanned in November 2026, 0% of the sites we could read passed the “AI discovery via DNS” check. On the sites scanned in both October 2026 and November 2026, the share stayed at 0%.
Line: Same sites Line: All sites (new ones included)
| Month | Applies to | All sites (new ones included) | Same sites |
|---|---|---|---|
| October 2026 | 100% | <1% | 0% |
| November 2026 | 100% | 0% | 0% |
Counting every site scanned in November 2026, 11% of the sites we could read passed the “MCP Server Card” check. On the sites scanned in both October 2026 and November 2026, the share stayed at 12%.
Line: Same sites Line: All sites (new ones included)
| Month | Applies to | All sites (new ones included) | Same sites |
|---|---|---|---|
| October 2026 | 100% | 1% | 12% |
| November 2026 | 100% | 11% | 12% |
Counting every site scanned in November 2026, 15% of the sites we could read passed the “OAuth authorization-server metadata” check. On the sites scanned in both October 2026 and November 2026, the share went from 16% to 15%.
Line: Same sites Line: All sites (new ones included)
| Month | Applies to | All sites (new ones included) | Same sites |
|---|---|---|---|
| October 2026 | 100% | 2% | 16% |
| November 2026 | 100% | 15% | 15% |
Counting every site scanned in November 2026, 8% of the sites we could read passed the “OAuth protected-resource metadata” check. On the sites scanned in both October 2026 and November 2026, the share went from 10% to 9%.
Line: Same sites Line: All sites (new ones included)
| Month | Applies to | All sites (new ones included) | Same sites |
|---|---|---|---|
| October 2026 | 100% | 2% | 10% |
| November 2026 | 100% | 8% | 9% |
Counting every site scanned in November 2026, 7% of the sites we could read passed the “OpenID Connect discovery” check. On the sites scanned in both October 2026 and November 2026, the share stayed at 7%.
Line: Same sites Line: All sites (new ones included)
| Month | Applies to | All sites (new ones included) | Same sites |
|---|---|---|---|
| October 2026 | 100% | 2% | 7% |
| November 2026 | 100% | 7% | 7% |
Counting every site scanned in November 2026, 1% of the sites we could read passed the “Web Bot Auth (operates a signed bot)” check. On the sites scanned in both October 2026 and November 2026, the share stayed at 1%.
Line: Same sites Line: All sites (new ones included)
| Month | Applies to | All sites (new ones included) | Same sites |
|---|---|---|---|
| October 2026 | 100% | <1% | 1% |
| November 2026 | 100% | 1% | 1% |
Counting every site scanned in November 2026, 22% of the sites we could read passed the “AI bot rules are explicit and intentional” check. On the sites scanned in both October 2026 and November 2026, the share went from 24% to 23%.
Line: Same sites Line: All sites (new ones included)
| Month | Applies to | All sites (new ones included) | Same sites |
|---|---|---|---|
| October 2026 | 100% | 11% | 24% |
| November 2026 | 100% | 22% | 23% |
Counting every site scanned in November 2026, 75% of the sites we could read passed the “AI crawlers aren't blocked” check. On the sites scanned in both August 2026 and November 2026, the share went from 77% to 75%.
Line: Same sites Line: All sites (new ones included)
| Month | Applies to | All sites (new ones included) | Same sites |
|---|---|---|---|
| August 2026 | 100% | 78% | 77% |
| September 2026 | 100% | 81% | 77% |
| October 2026 | 100% | 95% | 77% |
| November 2026 | 100% | 75% | 75% |
Counting every site scanned in November 2026, 49% of the sites we could read passed the “Analytics is installed” check. On the sites scanned in both October 2026 and November 2026, the share stayed at 49%.
Line: Same sites Line: All sites (new ones included)
| Month | Applies to | All sites (new ones included) | Same sites |
|---|---|---|---|
| October 2026 | 100% | 77% | 49% |
| November 2026 | 100% | 49% | 49% |
Counting every site scanned in November 2026, 97% of the sites where it applies (95% of the sites we could read) passed the “Descriptive anchor text” check. On the sites scanned in both October 2026 and November 2026, the share stayed at 98%.
Line: Same sites Line: All sites (new ones included)
| Month | Applies to | All sites (new ones included) | Same sites |
|---|---|---|---|
| October 2026 | 98% | 99% | 98% |
| November 2026 | 95% | 97% | 98% |
Counting every site scanned in November 2026, 52% of the sites we could read passed the “Author / publisher is clear” check. On the sites scanned in both October 2026 and November 2026, the share went from 53% to 52%.
Line: Same sites Line: All sites (new ones included)
| Month | Applies to | All sites (new ones included) | Same sites |
|---|---|---|---|
| October 2026 | 100% | 50% | 53% |
| November 2026 | 100% | 52% | 52% |
Counting every site scanned in November 2026, 82% of the sites where it applies (94% of the sites we could read) passed the “No broken links” check. On the sites scanned in both October 2026 and November 2026, the share went from 91% to 85%.
Line: Same sites Line: All sites (new ones included)
| Month | Applies to | All sites (new ones included) | Same sites |
|---|---|---|---|
| October 2026 | 98% | 88% | 91% |
| November 2026 | 94% | 82% | 85% |
Counting every site scanned in November 2026, 84% of the sites we could read passed the “Caching or validation headers are set” check. On the sites scanned in both October 2026 and November 2026, the share went from 85% to 86%.
Line: Same sites Line: All sites (new ones included)
| Month | Applies to | All sites (new ones included) | Same sites |
|---|---|---|---|
| October 2026 | 100% | 96% | 85% |
| November 2026 | 100% | 84% | 86% |
Counting every site scanned in November 2026, 71% of the sites we could read passed the “This page declares its canonical URL” check. On the sites scanned in both October 2026 and November 2026, the share stayed at 72%.
Line: Same sites Line: All sites (new ones included)
| Month | Applies to | All sites (new ones included) | Same sites |
|---|---|---|---|
| October 2026 | 100% | 57% | 72% |
| November 2026 | 100% | 71% | 72% |
Counting every site scanned in November 2026, 81% of the sites we could read passed the “The site settles on one host (www vs non-www)” check. On the sites scanned in both October 2026 and November 2026, the share stayed at 80%.
Line: Same sites Line: All sites (new ones included)
| Month | Applies to | All sites (new ones included) | Same sites |
|---|---|---|---|
| October 2026 | 100% | 89% | 80% |
| November 2026 | 100% | 81% | 80% |
Counting every site scanned in November 2026, 85% of the sites we could read passed the “Content is scannable in self-contained chunks” check. On the sites scanned in both October 2026 and November 2026, the share stayed at 85%.
Line: Same sites Line: All sites (new ones included)
| Month | Applies to | All sites (new ones included) | Same sites |
|---|---|---|---|
| October 2026 | 100% | 95% | 85% |
| November 2026 | 100% | 85% | 85% |
Counting every site scanned in November 2026, 93% of the sites we could read passed the “Your answer is in the HTML” check. On the sites scanned in both October 2026 and November 2026, the share went from 91% to 92%.
Line: Same sites Line: All sites (new ones included)
| Month | Applies to | All sites (new ones included) | Same sites |
|---|---|---|---|
| October 2026 | 100% | 96% | 91% |
| November 2026 | 100% | 93% | 92% |
Counting every site scanned in November 2026, 12% of the sites we could read passed the “Content usage preferences declared” check. On the sites scanned in both October 2026 and November 2026, the share went from 9% to 11%.
Line: Same sites Line: All sites (new ones included)
| Month | Applies to | All sites (new ones included) | Same sites |
|---|---|---|---|
| October 2026 | 100% | 3% | 9% |
| November 2026 | 100% | 12% | 11% |
Counting every site scanned in November 2026, 81% of the sites we could read passed the “Missing pages return a real 404” check. On the sites scanned in both October 2026 and November 2026, the share went from 84% to 79%.
Line: Same sites Line: All sites (new ones included)
| Month | Applies to | All sites (new ones included) | Same sites |
|---|---|---|---|
| October 2026 | 100% | 96% | 84% |
| November 2026 | 100% | 81% | 79% |
Counting every site scanned in November 2026, 47% of the sites where it applies (20% of the sites we could read) passed the “FAQ / Q&A schema” check. On the sites scanned in both September 2026 and October 2026, the share went from 44% to 51%.
Line: Same sites Line: All sites (new ones included)
| Month | Applies to | All sites (new ones included) | Same sites |
|---|---|---|---|
| August 2026 | 15% | 30% | — |
| September 2026 | 13% | 43% | 44% |
| October 2026 | 20% | 47% | 51% |
| November 2026 | 9% | — | — |
Counting every site scanned in November 2026, 96% of the sites we could read passed the “A favicon is set” check. On the sites scanned in both October 2026 and November 2026, the share stayed at 96%.
Line: Same sites Line: All sites (new ones included)
| Month | Applies to | All sites (new ones included) | Same sites |
|---|---|---|---|
| October 2026 | 100% | 99% | 96% |
| November 2026 | 100% | 96% | 96% |
Counting every site scanned in November 2026, 18% of the sites we could read passed the “A machine-readable published / updated date” check. On the sites scanned in both October 2026 and November 2026, the share stayed at 18%.
Line: Same sites Line: All sites (new ones included)
| Month | Applies to | All sites (new ones included) | Same sites |
|---|---|---|---|
| October 2026 | 100% | 8% | 18% |
| November 2026 | 100% | 18% | 18% |
Counting every site scanned in November 2026, 74% of the sites we could read passed the “Logical heading order” check. On the sites scanned in both October 2026 and November 2026, the share went from 71% to 73%.
Line: Same sites Line: All sites (new ones included)
| Month | Applies to | All sites (new ones included) | Same sites |
|---|---|---|---|
| October 2026 | 100% | 64% | 71% |
| November 2026 | 100% | 74% | 73% |
Counting every site scanned in November 2026, 95% of the sites we could read passed the “Reached without a redirect chain” check. On the sites scanned in both October 2026 and November 2026, the share went from 97% to 96%.
Line: Same sites Line: All sites (new ones included)
| Month | Applies to | All sites (new ones included) | Same sites |
|---|---|---|---|
| October 2026 | 100% | 99% | 97% |
| November 2026 | 100% | 95% | 96% |
Counting every site scanned in November 2026, 99% of the sites we could read passed the “Served over a secure HTTPS connection” check. On the sites scanned in both October 2026 and November 2026, the share stayed at 99%.
Line: Same sites Line: All sites (new ones included)
| Month | Applies to | All sites (new ones included) | Same sites |
|---|---|---|---|
| October 2026 | 100% | >99% | 99% |
| November 2026 | 100% | 99% | 99% |
Counting every site scanned in November 2026, 80% of the sites we could read passed the “HTTP redirects to HTTPS” check. On the sites scanned in both October 2026 and November 2026, the share went from 81% to 80%.
Line: Same sites Line: All sites (new ones included)
| Month | Applies to | All sites (new ones included) | Same sites |
|---|---|---|---|
| October 2026 | 100% | 96% | 81% |
| November 2026 | 100% | 80% | 80% |
Counting every site scanned in November 2026, 89% of the sites where it applies (83% of the sites we could read) passed the “Images have descriptive alt text” check. On the sites scanned in both October 2026 and November 2026, the share stayed at 87%.
Line: Same sites Line: All sites (new ones included)
| Month | Applies to | All sites (new ones included) | Same sites |
|---|---|---|---|
| October 2026 | 96% | 98% | 87% |
| November 2026 | 83% | 89% | 87% |
Counting every site scanned in November 2026, 39% of the sites where it applies (83% of the sites we could read) passed the “Images are optimised” check. On the sites scanned in both October 2026 and November 2026, the share stayed at 38%.
Line: Same sites Line: All sites (new ones included)
| Month | Applies to | All sites (new ones included) | Same sites |
|---|---|---|---|
| October 2026 | 96% | 11% | 38% |
| November 2026 | 83% | 39% | 38% |
Counting every site scanned in November 2026, 57% of the sites we could read passed the “Structured data is present” check. On the sites scanned in both August 2026 and November 2026, the share went from 53% to 57%.
Line: Same sites Line: All sites (new ones included)
| Month | Applies to | All sites (new ones included) | Same sites |
|---|---|---|---|
| August 2026 | 100% | 57% | 53% |
| September 2026 | 100% | 61% | 54% |
| October 2026 | 100% | 55% | 58% |
| November 2026 | 100% | 57% | 57% |
Counting every site scanned in November 2026, 64% of the sites we could read passed the “Topic is consistent across title, H1 and description” check. On the sites scanned in both October 2026 and November 2026, the share went from 61% to 63%.
Line: Same sites Line: All sites (new ones included)
| Month | Applies to | All sites (new ones included) | Same sites |
|---|---|---|---|
| October 2026 | 100% | 67% | 61% |
| November 2026 | 100% | 64% | 63% |
Counting every site scanned in November 2026, 89% of the sites we could read passed the “Language and charset declared” check. On the sites scanned in both October 2026 and November 2026, the share stayed at 88%.
Line: Same sites Line: All sites (new ones included)
| Month | Applies to | All sites (new ones included) | Same sites |
|---|---|---|---|
| October 2026 | 100% | 84% | 88% |
| November 2026 | 100% | 89% | 88% |
Counting every site scanned in November 2026, 10% of the sites we could read passed the “Resource-discovery Link headers” check. On the sites scanned in both October 2026 and November 2026, the share stayed at 11%.
Line: Same sites Line: All sites (new ones included)
| Month | Applies to | All sites (new ones included) | Same sites |
|---|---|---|---|
| October 2026 | 100% | 1% | 11% |
| November 2026 | 100% | 10% | 11% |
Counting every site scanned in November 2026, 92% of the sites where it applies (94% of the sites we could read) passed the “Sensible internal/external link mix” check. On the sites scanned in both October 2026 and November 2026, the share stayed at 92%.
Line: Same sites Line: All sites (new ones included)
| Month | Applies to | All sites (new ones included) | Same sites |
|---|---|---|---|
| October 2026 | 98% | 96% | 92% |
| November 2026 | 94% | 92% | 92% |
Counting every site scanned in November 2026, 34% of the sites we could read passed the “llms.txt is present and valid” check. On the sites scanned in both August 2026 and November 2026, the share went from 32% to 35%.
Line: Same sites Line: All sites (new ones included)
| Month | Applies to | All sites (new ones included) | Same sites |
|---|---|---|---|
| August 2026 | 100% | 30% | 32% |
| September 2026 | 100% | 28% | 31% |
| October 2026 | 100% | 29% | 35% |
| November 2026 | 100% | 34% | 35% |
Counting every site scanned in November 2026, 13% of the sites we could read passed the “Clean content for agents (Markdown)” check. On the sites scanned in both October 2026 and November 2026, the share went from 15% to 13%.
Line: Same sites Line: All sites (new ones included)
| Month | Applies to | All sites (new ones included) | Same sites |
|---|---|---|---|
| October 2026 | 100% | 4% | 15% |
| November 2026 | 100% | 13% | 13% |
Counting every site scanned in November 2026, 85% of the sites we could read passed the “Has a meta description” check. On the sites scanned in both October 2026 and November 2026, the share stayed at 85%.
Line: Same sites Line: All sites (new ones included)
| Month | Applies to | All sites (new ones included) | Same sites |
|---|---|---|---|
| October 2026 | 100% | 94% | 85% |
| November 2026 | 100% | 85% | 85% |
Counting every site scanned in November 2026, 96% of the sites we could read passed the “No meta-refresh redirect” check. On the sites scanned in both October 2026 and November 2026, the share stayed at 97%.
Line: Same sites Line: All sites (new ones included)
| Month | Applies to | All sites (new ones included) | Same sites |
|---|---|---|---|
| October 2026 | 100% | >99% | 97% |
| November 2026 | 100% | 96% | 97% |
Counting every site scanned in November 2026, 99% of the sites we could read passed the “Not accidentally set to noindex” check. On the sites scanned in both October 2026 and November 2026, the share stayed at 100%.
Line: Same sites Line: All sites (new ones included)
| Month | Applies to | All sites (new ones included) | Same sites |
|---|---|---|---|
| October 2026 | 100% | 99% | 100% |
| November 2026 | 100% | 99% | 100% |
Counting every site scanned in November 2026, 99% of the sites we could read passed the “No mixed (insecure) content” check. On the sites scanned in both October 2026 and November 2026, the share stayed at 99%.
Line: Same sites Line: All sites (new ones included)
| Month | Applies to | All sites (new ones included) | Same sites |
|---|---|---|---|
| October 2026 | 100% | 99% | 99% |
| November 2026 | 100% | 99% | 99% |
Counting every site scanned in November 2026, 60% of the sites we could read passed the “Open Graph tags for sharing” check. On the sites scanned in both October 2026 and November 2026, the share went from 60% to 59%.
Line: Same sites Line: All sites (new ones included)
| Month | Applies to | All sites (new ones included) | Same sites |
|---|---|---|---|
| October 2026 | 100% | 18% | 60% |
| November 2026 | 100% | 60% | 59% |
Counting every site scanned in November 2026, 31% of the sites we could read passed the “Organization schema with sameAs” check. On the sites scanned in both August 2026 and November 2026, the share went from 30% to 31%.
Line: Same sites Line: All sites (new ones included)
| Month | Applies to | All sites (new ones included) | Same sites |
|---|---|---|---|
| August 2026 | 100% | 33% | 30% |
| September 2026 | 100% | 31% | 29% |
| October 2026 | 100% | 34% | 31% |
| November 2026 | 100% | 31% | 31% |
Counting every site scanned in November 2026, 74% of the sites where it applies (88% of the sites we could read) passed the “Links don't point at redirects” check. On the sites scanned in both October 2026 and November 2026, the share went from 84% to 77%.
Line: Same sites Line: All sites (new ones included)
| Month | Applies to | All sites (new ones included) | Same sites |
|---|---|---|---|
| October 2026 | 96% | 95% | 84% |
| November 2026 | 88% | 74% | 77% |
Counting every site scanned in November 2026, 85% of the sites we could read passed the “robots.txt is present and not over-blocking” check. On the sites scanned in both October 2026 and November 2026, the share went from 88% to 85%.
Line: Same sites Line: All sites (new ones included)
| Month | Applies to | All sites (new ones included) | Same sites |
|---|---|---|---|
| October 2026 | 100% | 92% | 88% |
| November 2026 | 100% | 85% | 85% |
Counting every site scanned in November 2026, 100% of the sites where it applies (98% of the sites we could read) passed the “Not flagged for malware or phishing” check. On the sites scanned in both October 2026 and November 2026, the share stayed at 100%.
Line: Same sites Line: All sites (new ones included)
| Month | Applies to | All sites (new ones included) | Same sites |
|---|---|---|---|
| October 2026 | >99% | 100% | 100% |
| November 2026 | 98% | 100% | 100% |
Counting every site scanned in November 2026, 82% of the sites we could read passed the “Search Console / Bing verification” check. On the sites scanned in both October 2026 and November 2026, the share stayed at 86%.
Line: Same sites Line: All sites (new ones included)
| Month | Applies to | All sites (new ones included) | Same sites |
|---|---|---|---|
| October 2026 | 100% | 82% | 86% |
| November 2026 | 100% | 82% | 86% |
Counting every site scanned in November 2026, 21% of the sites we could read passed the “Core security headers are set” check. On the sites scanned in both October 2026 and November 2026, the share stayed at 24%.
Line: Same sites Line: All sites (new ones included)
| Month | Applies to | All sites (new ones included) | Same sites |
|---|---|---|---|
| October 2026 | 100% | 6% | 24% |
| November 2026 | 100% | 21% | 24% |
Counting every site scanned in November 2026, 21% of the sites we could read passed the “security.txt is published” check. On the sites scanned in both October 2026 and November 2026, the share went from 24% to 23%.
Line: Same sites Line: All sites (new ones included)
| Month | Applies to | All sites (new ones included) | Same sites |
|---|---|---|---|
| October 2026 | 100% | 4% | 24% |
| November 2026 | 100% | 21% | 23% |
Counting every site scanned in November 2026, 70% of the sites we could read passed the “Semantic HTML landmarks” check. On the sites scanned in both October 2026 and November 2026, the share stayed at 70%.
Line: Same sites Line: All sites (new ones included)
| Month | Applies to | All sites (new ones included) | Same sites |
|---|---|---|---|
| October 2026 | 100% | 49% | 70% |
| November 2026 | 100% | 70% | 70% |
Counting every site scanned in November 2026, 84% of the sites we could read passed the “No server version leakage” check. On the sites scanned in both October 2026 and November 2026, the share stayed at 84%.
Line: Same sites Line: All sites (new ones included)
| Month | Applies to | All sites (new ones included) | Same sites |
|---|---|---|---|
| October 2026 | 100% | 95% | 84% |
| November 2026 | 100% | 84% | 84% |
Counting every site scanned in November 2026, 70% of the sites we could read passed the “The page has an H1” check. On the sites scanned in both October 2026 and November 2026, the share stayed at 67%.
Line: Same sites Line: All sites (new ones included)
| Month | Applies to | All sites (new ones included) | Same sites |
|---|---|---|---|
| October 2026 | 100% | 90% | 67% |
| November 2026 | 100% | 70% | 67% |
Counting every site scanned in November 2026, 64% of the sites we could read passed the “XML sitemap is present and referenced” check. On the sites scanned in both August 2026 and November 2026, the share went from 68% to 66%.
Line: Same sites Line: All sites (new ones included)
| Month | Applies to | All sites (new ones included) | Same sites |
|---|---|---|---|
| August 2026 | 100% | 69% | 68% |
| September 2026 | 100% | 71% | 69% |
| October 2026 | 100% | 77% | 69% |
| November 2026 | 100% | 64% | 66% |
Counting every site scanned in November 2026, 99% of the sites we could read passed the “Has a title tag” check. On the sites scanned in both October 2026 and November 2026, the share stayed at 99%.
Line: Same sites Line: All sites (new ones included)
| Month | Applies to | All sites (new ones included) | Same sites |
|---|---|---|---|
| October 2026 | 100% | >99% | 99% |
| November 2026 | 100% | 99% | 99% |
Counting every site scanned in November 2026, 69% of the sites we could read passed the “Twitter/X card tags” check. On the sites scanned in both October 2026 and November 2026, the share went from 69% to 68%.
Line: Same sites Line: All sites (new ones included)
| Month | Applies to | All sites (new ones included) | Same sites |
|---|---|---|---|
| October 2026 | 100% | 75% | 69% |
| November 2026 | 100% | 69% | 68% |
Counting every site scanned in November 2026, 79% of the sites we could read passed the “Mobile viewport is set” check. On the sites scanned in both October 2026 and November 2026, the share stayed at 76%.
Line: Same sites Line: All sites (new ones included)
| Month | Applies to | All sites (new ones included) | Same sites |
|---|---|---|---|
| October 2026 | 100% | 96% | 76% |
| November 2026 | 100% | 79% | 76% |
Counting every site scanned in November 2026, 98% of the sites where it applies (55% of the sites we could read) passed the “Structured data is valid” check. On the sites scanned in both October 2026 and November 2026, the share stayed at 98%.
Line: Same sites Line: All sites (new ones included)
| Month | Applies to | All sites (new ones included) | Same sites |
|---|---|---|---|
| October 2026 | 55% | 97% | 98% |
| November 2026 | 55% | 98% | 98% |
Counting every site scanned in November 2026, 86% of the sites where it applies (55% of the sites we could read) passed the “Right schema type for the page” check. On the sites scanned in both October 2026 and November 2026, the share stayed at 85%.
Line: Same sites Line: All sites (new ones included)
| Month | Applies to | All sites (new ones included) | Same sites |
|---|---|---|---|
| October 2026 | 55% | 96% | 85% |
| November 2026 | 55% | 86% | 85% |
Counting every site scanned in November 2026, 45% of the sites where it applies (99% of the sites we could read) passed the “Title fits a search snippet” check. On the sites scanned in both October 2026 and November 2026, the share stayed at 46%.
Line: Same sites Line: All sites (new ones included)
| Month | Applies to | All sites (new ones included) | Same sites |
|---|---|---|---|
| October 2026 | >99% | 60% | 46% |
| November 2026 | 99% | 45% | 46% |
Counting every site scanned in November 2026, 30% of the sites where it applies (2% of the sites we could read) passed the “Breadcrumb structured data” check.
Line: Same sites Line: All sites (new ones included)
| Month | Applies to | All sites (new ones included) | Same sites |
|---|---|---|---|
| August 2026 | 9% | — | — |
| September 2026 | 17% | 29% | — |
| October 2026 | 2% | 30% | 30% |
| November 2026 | 7% | — | — |
Counting every site scanned in November 2026, 6% of the sites we could read passed the “AI catalog” check. On the sites scanned in both October 2026 and November 2026, the share stayed at 6%.
Line: Same sites Line: All sites (new ones included)
| Month | Applies to | All sites (new ones included) | Same sites |
|---|---|---|---|
| October 2026 | 100% | 1% | 6% |
| November 2026 | 100% | 6% | 6% |
Counting every site scanned in November 2026, 92% of the sites we could read passed the “Your content survives without JavaScript” check. On the sites scanned in both October 2026 and November 2026, the share stayed at 91%.
Line: Same sites Line: All sites (new ones included)
| Month | Applies to | All sites (new ones included) | Same sites |
|---|---|---|---|
| October 2026 | 100% | 97% | 91% |
| November 2026 | 100% | 92% | 91% |
Counting every site scanned in November 2026, 4% of the sites we could read passed the “A2A Agent Card” check. On the sites scanned in both October 2026 and November 2026, the share stayed at 4%.
Line: Same sites Line: All sites (new ones included)
| Month | Applies to | All sites (new ones included) | Same sites |
|---|---|---|---|
| October 2026 | >99% | <1% | 4% |
| November 2026 | 100% | 4% | 4% |
Counting every site scanned in November 2026, 0% of the sites we could read passed the “AI usage preferences (Content-Usage)” check. On the sites scanned in both October 2026 and November 2026, the share stayed at 0%.
Line: Same sites Line: All sites (new ones included)
| Month | Applies to | All sites (new ones included) | Same sites |
|---|---|---|---|
| October 2026 | >99% | <1% | 0% |
| November 2026 | 100% | 0% | 0% |
Counting every site scanned in November 2026, 7% of the sites we could read passed the “Markdown version linked from the page” check. On the sites scanned in both October 2026 and November 2026, the share stayed at 8%.
Line: Same sites Line: All sites (new ones included)
| Month | Applies to | All sites (new ones included) | Same sites |
|---|---|---|---|
| October 2026 | >99% | 1% | 8% |
| November 2026 | 100% | 7% | 8% |
Counting every site scanned in November 2026, 0% of the sites we could read passed the “Licensing terms for AI (RSL)” check. On the sites scanned in both October 2026 and November 2026, the share stayed at 0%.
Line: Same sites Line: All sites (new ones included)
| Month | Applies to | All sites (new ones included) | Same sites |
|---|---|---|---|
| October 2026 | >99% | <1% | 0% |
| November 2026 | 100% | 0% | 0% |
Counting every site scanned in November 2026, 0% of the sites we could read passed the “Text-and-data-mining reservation (TDMRep)” check. On the sites scanned in both October 2026 and November 2026, the share stayed at 0%.
Line: Same sites Line: All sites (new ones included)
| Month | Applies to | All sites (new ones included) | Same sites |
|---|---|---|---|
| October 2026 | >99% | <1% | 0% |
| November 2026 | 100% | 0% | 0% |
Counting every site scanned in November 2026, 3% of the sites we could read passed the “WebMCP tools in the page” check. On the sites scanned in both October 2026 and November 2026, the share stayed at 3%.
Line: Same sites Line: All sites (new ones included)
| Month | Applies to | All sites (new ones included) | Same sites |
|---|---|---|---|
| October 2026 | >99% | <1% | 3% |
| November 2026 | 100% | 3% | 3% |
Counting every site scanned in November 2026, 53% of the sites where it applies (94% of the sites we could read) passed the “Buttons, links and fields have names” check. On the sites scanned in both October 2026 and November 2026, the share went from 54% to 55%.
Line: Same sites Line: All sites (new ones included)
| Month | Applies to | All sites (new ones included) | Same sites |
|---|---|---|---|
| October 2026 | 98% | 30% | 54% |
| November 2026 | 94% | 53% | 55% |
Counting every site scanned in November 2026, 55% of the sites where it applies (71% of the sites we could read) passed the “Claims come with figures, quotes or sources” check. On the sites scanned in both October 2026 and November 2026, the share went from 60% to 58%.
Line: Same sites Line: All sites (new ones included)
| Month | Applies to | All sites (new ones included) | Same sites |
|---|---|---|---|
| October 2026 | 80% | 55% | 60% |
| November 2026 | 71% | 55% | 58% |
Counting every site scanned in November 2026, 95% of the sites we could read passed the “Your page's HTML isn't oversized” check. On the sites scanned in both October 2026 and November 2026, the share stayed at 96%.
Line: Same sites Line: All sites (new ones included)
| Month | Applies to | All sites (new ones included) | Same sites |
|---|---|---|---|
| October 2026 | >99% | 99% | 96% |
| November 2026 | 100% | 95% | 96% |
Counting every site scanned in November 2026, 66% of the sites where it applies (85% of the sites we could read) passed the “Description fits a search snippet” check. On the sites scanned in both October 2026 and November 2026, the share stayed at 63%.
Line: Same sites Line: All sites (new ones included)
| Month | Applies to | All sites (new ones included) | Same sites |
|---|---|---|---|
| October 2026 | 94% | 65% | 63% |
| November 2026 | 85% | 66% | 63% |
Counting every site scanned in November 2026, 32% of the sites where it applies (64% of the sites we could read) passed the “Section headings are phrased as questions” check. On the sites scanned in both October 2026 and November 2026, the share stayed at 33%.
Line: Same sites Line: All sites (new ones included)
| Month | Applies to | All sites (new ones included) | Same sites |
|---|---|---|---|
| October 2026 | 77% | 22% | 33% |
| November 2026 | 64% | 32% | 33% |
Counting every site scanned in November 2026, 91% of the sites we could read passed the “Your page arrives quickly” check. On the sites scanned in both October 2026 and November 2026, the share went from 94% to 93%.
Line: Same sites Line: All sites (new ones included)
| Month | Applies to | All sites (new ones included) | Same sites |
|---|---|---|---|
| October 2026 | >99% | 97% | 94% |
| November 2026 | 100% | 91% | 93% |
Counting every site scanned in November 2026, 93% of the sites we could read passed the “Engines are allowed to quote the page” check. On the sites scanned in both October 2026 and November 2026, the share stayed at 93%.
Line: Same sites Line: All sites (new ones included)
| Month | Applies to | All sites (new ones included) | Same sites |
|---|---|---|---|
| October 2026 | >99% | 99% | 93% |
| November 2026 | 100% | 93% | 93% |
Counting every site scanned in November 2026, 90% of the sites where it applies (94% of the sites we could read) passed the “Links are real links” check. On the sites scanned in both October 2026 and November 2026, the share went from 90% to 91%.
Line: Same sites Line: All sites (new ones included)
| Month | Applies to | All sites (new ones included) | Same sites |
|---|---|---|---|
| October 2026 | 98% | 93% | 90% |
| November 2026 | 94% | 90% | 91% |
Counting every site scanned in November 2026, 32% of the sites we could read published Organization structured data as a type of its own. On the sites scanned in both August 2026 and November 2026, the share went from 27% to 29%.
Line: Same sites Line: All sites (new ones included)
| Month | All sites (new ones included) | Same sites |
|---|---|---|
| August 2026 | 30% | 27% |
| September 2026 | 35% | 29% |
| October 2026 | 36% | 31% |
| November 2026 | 32% | 29% |
Counting every site scanned in November 2026, 36% of the sites we could read published WebSite structured data as a type of its own. On the sites scanned in both August 2026 and November 2026, the share went from 35% to 33%.
Line: Same sites Line: All sites (new ones included)
| Month | All sites (new ones included) | Same sites |
|---|---|---|
| August 2026 | 33% | 35% |
| September 2026 | 38% | 33% |
| October 2026 | 27% | 34% |
| November 2026 | 36% | 33% |
Counting every site scanned in November 2026, 19% of the sites we could read published WebPage structured data as a type of its own. On the sites scanned in both August 2026 and November 2026, the share went from 17% to 18%.
Line: Same sites Line: All sites (new ones included)
| Month | All sites (new ones included) | Same sites |
|---|---|---|
| August 2026 | 21% | 17% |
| September 2026 | 23% | 18% |
| October 2026 | 18% | 19% |
| November 2026 | 19% | 18% |
Counting every site scanned in November 2026, 7% of the sites we could read published SoftwareApplication structured data as a type of its own. On the sites scanned in both August 2026 and November 2026, the share went from 6% to 7%.
Line: Same sites Line: All sites (new ones included)
| Month | All sites (new ones included) | Same sites |
|---|---|---|
| August 2026 | 7% | 6% |
| September 2026 | 5% | 7% |
| October 2026 | 8% | 7% |
| November 2026 | 7% | 7% |
Counting every site scanned in November 2026, 2% of the sites we could read published Service structured data as a type of its own. On the sites scanned in both August 2026 and November 2026, the share stayed at 2%.
Line: Same sites Line: All sites (new ones included)
| Month | All sites (new ones included) | Same sites |
|---|---|---|
| August 2026 | 2% | 2% |
| September 2026 | 1% | 2% |
| October 2026 | 2% | 2% |
| November 2026 | 2% | 2% |
Counting every site scanned in November 2026, 3% of the sites we could read published FAQPage structured data as a type of its own. On the sites scanned in both August 2026 and November 2026, the share stayed at 2%.
Line: Same sites Line: All sites (new ones included)
| Month | All sites (new ones included) | Same sites |
|---|---|---|
| August 2026 | 4% | 2% |
| September 2026 | 6% | 3% |
| October 2026 | 7% | 3% |
| November 2026 | 3% | 2% |
Counting every site scanned in November 2026, 7% of the sites we could read published Article structured data as a type of its own. On the sites scanned in both August 2026 and November 2026, the share stayed at 6%.
Line: Same sites Line: All sites (new ones included)
| Month | All sites (new ones included) | Same sites |
|---|---|---|
| August 2026 | 3% | 6% |
| September 2026 | 4% | 6% |
| October 2026 | 1% | 6% |
| November 2026 | 7% | 6% |
Counting every site scanned in November 2026, 4% of the sites we could read published TechArticle structured data as a type of its own. On the sites scanned in both August 2026 and November 2026, the share went from 3% to 4%.
Line: Same sites Line: All sites (new ones included)
| Month | All sites (new ones included) | Same sites |
|---|---|---|
| August 2026 | 1% | 3% |
| September 2026 | 1% | 4% |
| October 2026 | <1% | 4% |
| November 2026 | 4% | 4% |
Counting every site scanned in November 2026, 6% of the sites we could read published NewsMediaOrganization structured data as a type of its own. On the sites scanned in both August 2026 and November 2026, the share went from 8% to 6%.
Line: Same sites Line: All sites (new ones included)
| Month | All sites (new ones included) | Same sites |
|---|---|---|
| August 2026 | 4% | 8% |
| September 2026 | 3% | 6% |
| October 2026 | <1% | 6% |
| November 2026 | 6% | 6% |
Counting every site scanned in November 2026, 2% of the sites we could read published ItemList structured data as a type of its own. On the sites scanned in both August 2026 and November 2026, the share stayed at 2%.
Line: Same sites Line: All sites (new ones included)
| Month | All sites (new ones included) | Same sites |
|---|---|---|
| August 2026 | 2% | 2% |
| September 2026 | 3% | 3% |
| October 2026 | 2% | 3% |
| November 2026 | 2% | 2% |
Counting every site scanned in November 2026, 5% of the sites we could read published Person structured data as a type of its own. On the sites scanned in both August 2026 and November 2026, the share stayed at 4%.
Line: Same sites Line: All sites (new ones included)
| Month | All sites (new ones included) | Same sites |
|---|---|---|
| August 2026 | 7% | 4% |
| September 2026 | 7% | 4% |
| October 2026 | 3% | 4% |
| November 2026 | 5% | 4% |
Counting every site scanned in November 2026, 7% of the sites we could read published BreadcrumbList structured data as a type of its own. On the sites scanned in both August 2026 and November 2026, the share went from 5% to 7%.
Line: Same sites Line: All sites (new ones included)
| Month | All sites (new ones included) | Same sites |
|---|---|---|
| August 2026 | 7% | 5% |
| September 2026 | 15% | 6% |
| October 2026 | 5% | 7% |
| November 2026 | 7% | 7% |
Counting every site scanned in November 2026, 0% of the sites we could read published Place structured data as a type of its own. On the sites scanned in both August 2026 and November 2026, the share stayed at 0%.
Line: Same sites Line: All sites (new ones included)
| Month | All sites (new ones included) | Same sites |
|---|---|---|
| August 2026 | <1% | 0% |
| September 2026 | 2% | 0% |
| October 2026 | 1% | 0% |
| November 2026 | 0% | 0% |
Counting every site scanned in November 2026, 4% of the sites we could read published ImageObject structured data as a type of its own. On the sites scanned in both August 2026 and November 2026, the share went from 2% to 3%.
Line: Same sites Line: All sites (new ones included)
| Month | All sites (new ones included) | Same sites |
|---|---|---|
| August 2026 | 4% | 2% |
| September 2026 | 9% | 2% |
| October 2026 | 3% | 3% |
| November 2026 | 4% | 3% |
Counting every site scanned in November 2026, 0% of the sites we could read published LocalBusiness structured data as a type of its own. On the sites scanned in both August 2026 and November 2026, the share stayed at 0%.
Line: Same sites Line: All sites (new ones included)
| Month | All sites (new ones included) | Same sites |
|---|---|---|
| August 2026 | 2% | 0% |
| September 2026 | 4% | 0% |
| October 2026 | 5% | 0% |
| November 2026 | 0% | 0% |
Counting every site scanned in November 2026, 0% of the sites we could read published ProfessionalService structured data as a type of its own. On the sites scanned in both August 2026 and November 2026, the share stayed at 0%.
Line: Same sites Line: All sites (new ones included)
| Month | All sites (new ones included) | Same sites |
|---|---|---|
| August 2026 | 3% | 0% |
| September 2026 | 2% | 0% |
| October 2026 | 3% | 0% |
| November 2026 | 0% | 0% |
Counting every site scanned in November 2026, 6% of the sites we could read published CollectionPage structured data as a type of its own. On the sites scanned in both August 2026 and November 2026, the share stayed at 6%.
Line: Same sites Line: All sites (new ones included)
| Month | All sites (new ones included) | Same sites |
|---|---|---|
| August 2026 | 4% | 6% |
| September 2026 | 3% | 6% |
| October 2026 | <1% | 6% |
| November 2026 | 6% | 6% |
Counting every site scanned in November 2026, 2% of the sites we could read published Corporation structured data as a type of its own. On the sites scanned in both August 2026 and November 2026, the share stayed at 2%.
Line: Same sites Line: All sites (new ones included)
| Month | All sites (new ones included) | Same sites |
|---|---|---|
| August 2026 | 2% | 2% |
| September 2026 | 1% | 2% |
| October 2026 | 2% | 2% |
| November 2026 | 2% | 2% |
Counting every site scanned in November 2026, 0% of the sites we could read published ProfilePage structured data as a type of its own. On the sites scanned in both August 2026 and November 2026, the share stayed at 0%.
Line: Same sites Line: All sites (new ones included)
| Month | All sites (new ones included) | Same sites |
|---|---|---|
| August 2026 | 1% | 0% |
| September 2026 | 1% | 0% |
| October 2026 | 1% | 0% |
| November 2026 | 0% | 0% |
Counting every site scanned in November 2026, 0% of the sites we could read published NewsArticle structured data as a type of its own. On the sites scanned in both August 2026 and November 2026, the share stayed at 0%.
Line: Same sites Line: All sites (new ones included)
| Month | All sites (new ones included) | Same sites |
|---|---|---|
| August 2026 | <1% | 0% |
| September 2026 | 2% | 0% |
| October 2026 | <1% | 0% |
| November 2026 | 0% | 0% |
Counting every site scanned in November 2026, 0% of the sites we could read published SiteNavigationElement structured data as a type of its own. On the sites scanned in both August 2026 and November 2026, the share stayed at 0%.
Line: Same sites Line: All sites (new ones included)
| Month | All sites (new ones included) | Same sites |
|---|---|---|
| August 2026 | 0% | 0% |
| September 2026 | 1% | 0% |
| October 2026 | <1% | 0% |
| November 2026 | 0% | 0% |
Counting every site scanned in November 2026, 36% of the sites visitors scanned scored 91–100. On the sites scanned in both October 2026 and November 2026, the share stayed at 36%.
Line: Same sites Line: All sites (new ones included)
| Month | All sites (new ones included) | Same sites |
|---|---|---|
| October 2026 | 42% | 36% |
| November 2026 | 36% | 36% |
Counting every site scanned in November 2026, 25% of the sites visitors scanned scored 81–90.
Line: Same sites Line: All sites (new ones included)
| Month | All sites (new ones included) | Same sites |
|---|---|---|
| October 2026 | 35% | — |
| November 2026 | 25% | 25% |
Counting every site scanned in November 2026, 17% of the sites visitors scanned turned our scanner away. On the sites scanned in both October 2026 and November 2026, the share stayed at 18%.
Line: Same sites Line: All sites (new ones included)
| Month | All sites (new ones included) | Same sites |
|---|---|---|
| October 2026 | 2% | 18% |
| November 2026 | 17% | 18% |
These lines have one month of figures so far. Each becomes a month-by-month line once a second month of figures arrives.
| Series | All sites |
|---|---|
| Sites scoring 71–80 | 19% |
| Sites scoring 61–70 | 2% |
Checks that have only one month of figures are not listed here again: their latest figure is in Every check.
Based on the sites visitors have scanned with Bot Appétit. Not a random sample of the web.
July 2026, August 2026, September 2026, October 2026, November 2026
Not enough performance data yet.
Core Web Vitals are Google's three measures of loading, responsiveness and visual stability. Field results come from real Chrome visitors over the past four weeks. Lab results come from one test run.
| Result | Share of sites |
|---|---|
| Lab test: good | 30% |
| Lab test: needs improvement | 56% |
| Lab test: poor | 14% |
Based on the sites visitors have scanned with Bot Appétit. Not a random sample of the web.
In November 2026, 22% of the sites visitors scanned cleared every one of the gates.
The gates are “Automated visitors can reach your pages”, “AI crawlers aren't blocked”, “Reached without a redirect chain”, “Your answer is in the HTML”, “Structured data is present”, “llms.txt is present and valid”: the basics a machine needs before it can use a page.
| Gates cleared | Share of sites |
|---|---|
| No gates cleared | 5% |
| One of six gates cleared | 5% |
| Two of six gates cleared | 2% |
| Three of six gates cleared | 5% |
| Four of six gates cleared | 29% |
| Five of six gates cleared | 31% |
| All six gates cleared | 22% |
Based on the sites visitors have scanned with Bot Appétit. Not a random sample of the web.
Figures generated 2026-11-02 from build f6cab0d030f13630. Download the data as JSON or CSV; both hold percentages only.
Milk Moon Studio, "Bot Appétit State of the Web & AI Readiness", botappetit.ai/state-of-the-web/, figures from November 2026.
Figures change every hour, so say which month you took them from.
A free scan checks all of this on your page in seconds, with no signup.
Want it handled? We do that too. No pitch, just a plain-English chat.
Book a call