the free AEO + SEO readiness check How many of the sites we scan let our scanner in, and what they get right and wrong, check by check. Percentages only, refreshed every hour.
Updated 15:07 UTC · November 2026
Based on the sites Bot Appétit has scanned. Most of these sites come from lists we scan for research. Not a random sample of the web.
The check sites fail most often is “llms.txt is present and valid”: 69% of the sites we could read fail it. See the detail
The “FAQ / Q&A schema” check is the fastest-rising: 51% of the sites where it applies (19% of the sites we could read) pass it now, against 44% when this series began. Both figures are for the sites scanned in both the first month and the latest. See the detail
In November 2026, our scanner could read 96% of the sites we scanned. The other 4% turned it away.
This is our scanner, not every AI. A site that turns it away may still let other visitors in; how sites treat AI crawlers is in AI access, below.
Every page we read gets a score out of 100, the number at the top of its report (how scoring works). Each row is a range of scores. Where too few sites score in the lowest ranges, they are joined into one row. A site our scanner could not read has no score.
Based on the sites Bot Appétit has scanned. Most of these sites come from lists we scan for research. Not a random sample of the web.
In November 2026, 7% of the sites we scanned disallowed some AI crawlers in robots.txt, and 4% turned our scanner away at the server.
These shares are of every site we scanned, including the ones that turned our scanner away. The shares in Every check are of the sites we could read, so the same crawler check can read differently there.
Based on the sites Bot Appétit has scanned. Most of these sites come from lists we scan for research. Not a random sample of the web.
In November 2026, here is where the sites we scanned differ most.
In November 2026, the “OAuth authorization-server metadata” check showed the widest gap between platforms: 89% of Shopify sites passed it, against <1% of Webflow sites.
How sites on each platform treat AI crawlers in robots.txt
A platform is only known for pages our scanner could read, so this table cannot say how many sites on each platform turned our scanner away.
The checks that differ most between platforms, by the share of sites that pass. Each share is over the sites the check applies to.
On Webflow sites the Open Graph check almost always falls short on one tag, og:url, the page's own address: Webflow's page settings have no field for it. The title, description and image are usually there.
In November 2026, 12% of the sites we scanned behind Amazon CloudFront turned our scanner away at the server, and 0% allowed AI crawlers in robots.txt but turned our scanner away anyway.
In November 2026, 11% of the sites visitors scanned turned our scanner away, against 3% of the sites on our research lists.
Lists we scan for research are not a random sample of the web either.
The checks where the two groups differ most, by the share of sites that pass. Each share is over the sites the check applies to.
| Check | Scanned by visitors | Research lists |
|---|---|---|
| Buttons, links and fields have names | 66% | 30% |
| Open Graph tags for sharing | 55% | 20% |
| Analytics is installed | 43% | 77% |
| Images are optimised | 44% | 11% |
| Search Console / Bing verification | 59% | 82% |
| A machine-readable published / updated date | 27% | 9% |
| Links don't point at redirects | 75% | 93% |
| Claims come with figures, quotes or sources | 40% | 56% |
| No broken links | 73% | 88% |
| Semantic HTML landmarks | 64% | 49% |
Based on the sites Bot Appétit has scanned. Most of these sites come from lists we scan for research. Not a random sample of the web.
In November 2026, “Not flagged for malware or phishing” was the check sites passed most often: 100% of the sites where it applies (99% of the sites we could read) passed it. “llms.txt is present and valid” was the one they failed most often: 69% of the sites we could read failed it.
A dash means not enough sites yet. Each check links to what it is and what good looks like.
Applies to is the share of the sites we could read that the check ran on, because some checks have nothing to judge on many pages.
The other columns are shares of those sites, not of every site. Newer checks only cover sites scanned since the check was added.
“Automated visitors can reach your pages” shows a dash: a site passes it whenever our scanner could read the page, so it only repeats whether we got in. See how many turned us away.
Fixed and Broke compare re-scanned sites, and those columns are left out until there are enough of them. Not enough history yet.
Error:
| Check | Applies to | Result | Pass | Worth a look | To fix | Couldn't judge |
|---|---|---|---|---|---|---|
| Your content survives without JavaScript | Applies to >99% | Pass 97% | Worth a look 1% | To fix 1% | Couldn't judge 1% | |
| Your answer is in the HTML | Applies to 100% | Pass 96% | Worth a look 2% | To fix 2% | Couldn't judge 0% | |
| Semantic HTML landmarks | Applies to 100% | Pass 50% | Worth a look 50% | To fix 0% | Couldn't judge <1% | |
| Content is scannable in self-contained chunks | Applies to 100% | Pass 94% | Worth a look 6% | To fix 0% | Couldn't judge <1% | |
| Author / publisher is clear | Applies to 100% | Pass 50% | Worth a look 50% | To fix 0% | Couldn't judge <1% | |
| A machine-readable published / updated date | Applies to 100% | Pass 10% | Worth a look 89% | To fix 0% | Couldn't judge <1% | |
| llms.txt is present and valid | Applies to 100% | Pass 28% | Worth a look 1% | To fix 69% | Couldn't judge 2% | |
| Clean content for agents (Markdown) | Applies to 100% | Pass 4% | Worth a look 91% | To fix 0% | Couldn't judge 5% |
| Check | Applies to | Result | Pass | Worth a look | To fix | Couldn't judge |
|---|---|---|---|---|---|---|
| Buttons, links and fields have names | Applies to 86% | Pass 30% | Worth a look 64% | To fix 6% | Couldn't judge 0% | |
| AI crawlers aren't blocked | Applies to 100% | Pass 92% | Worth a look 5% | To fix 2% | Couldn't judge 1% | |
| Automated visitors can reach your pages See how many turned us away | Applies to — | Not enough sites yet | Pass — | Worth a look — | To fix — | Couldn't judge — |
| Engines are allowed to quote the page | Applies to 88% | Pass 99% | Worth a look <1% | To fix <1% | Couldn't judge 0% | |
| Your page arrives quickly | Applies to 88% | Pass 97% | Worth a look 2% | To fix 1% | Couldn't judge 0% |
| Check | Applies to | Result | Pass | Worth a look | To fix | Couldn't judge |
|---|---|---|---|---|---|---|
| AI bot rules are explicit and intentional | Applies to 100% | Pass 13% | Worth a look 86% | To fix 0% | Couldn't judge 1% |
| Check | Applies to | Result | Pass | Worth a look | To fix | Couldn't judge |
|---|---|---|---|---|---|---|
| Structured data is present | Applies to 100% | Pass 56% | Worth a look 0% | To fix 44% | Couldn't judge <1% | |
| Structured data is valid | Applies to 56% | Pass 97% | Worth a look 1% | To fix 2% | Couldn't judge <1% | |
| FAQ / Q&A schema | Applies to 19% | Pass 46% | Worth a look 54% | To fix 0% | Couldn't judge 0% | |
| Organization schema with sameAs | Applies to 100% | Pass 33% | Worth a look 17% | To fix 50% | Couldn't judge <1% | |
| Right schema type for the page | Applies to 55% | Pass 94% | Worth a look 5% | To fix 0% | Couldn't judge <1% | |
| Schema facts also appear in the page text | Applies to 24% | Pass 57% | Worth a look 43% | To fix 0% | Couldn't judge 0% | |
| Breadcrumb structured data | Applies to 5% | Pass 28% | Worth a look 72% | To fix 0% | Couldn't judge 0% |
| Check | Applies to | Result | Pass | Worth a look | To fix | Couldn't judge |
|---|---|---|---|---|---|---|
| Reached without a redirect chain | Applies to 100% | Pass 99% | Worth a look 1% | To fix 0% | Couldn't judge 0% | |
| Caching or validation headers are set | Applies to 100% | Pass 95% | Worth a look 5% | To fix 0% | Couldn't judge 0% | |
| The site settles on one host (www vs non-www) | Applies to 100% | Pass 87% | Worth a look 4% | To fix 6% | Couldn't judge 4% | |
| robots.txt is present and not over-blocking | Applies to 100% | Pass 91% | Worth a look <1% | To fix 8% | Couldn't judge <1% | |
| Not accidentally set to noindex | Applies to 100% | Pass 99% | Worth a look 0% | To fix 1% | Couldn't judge 0% | |
| This page declares its canonical URL | Applies to 100% | Pass 59% | Worth a look 5% | To fix 36% | Couldn't judge 0% | |
| Has a title tag | Applies to 100% | Pass >99% | Worth a look <1% | To fix <1% | Couldn't judge 0% | |
| Has a meta description | Applies to 100% | Pass 88% | Worth a look 5% | To fix 7% | Couldn't judge 0% | |
| The page has an H1 | Applies to 100% | Pass 86% | Worth a look 1% | To fix 12% | Couldn't judge <1% | |
| Logical heading order | Applies to 100% | Pass 63% | Worth a look 33% | To fix 1% | Couldn't judge 3% | |
| Topic is consistent across title, H1 and description | Applies to 100% | Pass 64% | Worth a look 20% | To fix 0% | Couldn't judge 16% | |
| Images have descriptive alt text | Applies to 95% | Pass 95% | Worth a look 4% | To fix 1% | Couldn't judge <1% | |
| Your page's HTML isn't oversized | Applies to 88% | Pass 99% | Worth a look <1% | To fix <1% | Couldn't judge 0% | |
| Open Graph tags for sharing | Applies to 100% | Pass 23% | Worth a look 69% | To fix 9% | Couldn't judge 0% | |
| XML sitemap is present and referenced | Applies to 100% | Pass 76% | Worth a look 7% | To fix 15% | Couldn't judge 2% | |
| Missing pages return a real 404 | Applies to 100% | Pass 94% | Worth a look 0% | To fix 3% | Couldn't judge 2% | |
| Language and charset declared | Applies to 100% | Pass 85% | Worth a look 15% | To fix 0% | Couldn't judge 0% | |
| hreflang for language variants | Applies to 17% | Pass 99% | Worth a look 1% | To fix 0% | Couldn't judge 0% | |
| No meta-refresh redirect | Applies to 100% | Pass >99% | Worth a look <1% | To fix 0% | Couldn't judge 0% |
| Check | Applies to | Result | Pass | Worth a look | To fix | Couldn't judge |
|---|---|---|---|---|---|---|
| No broken links | Applies to 97% | Pass 87% | Worth a look 9% | To fix 1% | Couldn't judge 3% | |
| Links don't point at redirects | Applies to 95% | Pass 93% | Worth a look 4% | To fix 0% | Couldn't judge 3% | |
| Descriptive anchor text | Applies to 98% | Pass 99% | Worth a look 1% | To fix 0% | Couldn't judge <1% | |
| Links are real links | Applies to 86% | Pass 93% | Worth a look 6% | To fix <1% | Couldn't judge 0% |
Not enough sites yet
| Check | Applies to | Result | Pass | Worth a look | To fix | Couldn't judge |
|---|---|---|---|---|---|---|
| Largest Contentful Paint (LCP) | Applies to — | Not enough sites yet | Pass — | Worth a look — | To fix — | Couldn't judge — |
| Cumulative Layout Shift (CLS) | Applies to — | Not enough sites yet | Pass — | Worth a look — | To fix — | Couldn't judge — |
| Interaction to Next Paint (INP) | Applies to — | Not enough sites yet | Pass — | Worth a look — | To fix — | Couldn't judge — |
| Page weight and render-blocking | Applies to — | Not enough sites yet | Pass — | Worth a look — | To fix — | Couldn't judge — |
| Check | Applies to | Result | Pass | Worth a look | To fix | Couldn't judge |
|---|---|---|---|---|---|---|
| Served over a secure HTTPS connection | Applies to 100% | Pass >99% | Worth a look 0% | To fix <1% | Couldn't judge 0% | |
| HTTP redirects to HTTPS | Applies to 100% | Pass 95% | Worth a look 1% | To fix 3% | Couldn't judge 1% | |
| No mixed (insecure) content | Applies to 100% | Pass 99% | Worth a look 1% | To fix <1% | Couldn't judge <1% | |
| Not flagged for malware or phishing | Applies to 99% | Pass 100% | Worth a look 0% | To fix 0% | Couldn't judge 0% |
| Check | Applies to | Result | Pass | Worth a look | To fix | Couldn't judge |
|---|---|---|---|---|---|---|
| Content usage preferences declared | Applies to 100% | Pass 4% | Worth a look 95% | To fix 0% | Couldn't judge 1% | |
| Resource-discovery Link headers | Applies to 100% | Pass 1% | Worth a look 99% | To fix 0% | Couldn't judge 0% | |
| MCP Server Card | Applies to 100% | Pass 1% | Worth a look 94% | To fix 0% | Couldn't judge 5% | |
| AI catalog | Applies to >99% | Pass 1% | Worth a look 95% | To fix 0% | Couldn't judge 4% | |
| A2A Agent Card | Applies to 88% | Pass <1% | Worth a look 96% | To fix 0% | Couldn't judge 3% | |
| WebMCP tools in the page | Applies to 88% | Pass <1% | Worth a look >99% | To fix 0% | Couldn't judge <1% | |
| AI usage preferences (Content-Usage) | Applies to 88% | Pass <1% | Worth a look 99% | To fix 0% | Couldn't judge 1% | |
| Licensing terms for AI (RSL) | Applies to 88% | Pass <1% | Worth a look 99% | To fix 0% | Couldn't judge 1% | |
| Text-and-data-mining reservation (TDMRep) | Applies to 88% | Pass <1% | Worth a look 97% | To fix 0% | Couldn't judge 3% | |
| Markdown version linked from the page | Applies to 88% | Pass 1% | Worth a look 99% | To fix 0% | Couldn't judge <1% | |
| Content signals agree everywhere | Applies to — | Not enough sites yet | Pass — | Worth a look — | To fix — | Couldn't judge — |
| Agent Skills index | Applies to 100% | Pass 1% | Worth a look 94% | To fix 0% | Couldn't judge 5% | |
| API catalog | Applies to 100% | Pass 1% | Worth a look 94% | To fix 0% | Couldn't judge 5% | |
| OAuth authorization-server metadata | Applies to 100% | Pass 3% | Worth a look 92% | To fix 0% | Couldn't judge 6% | |
| OAuth protected-resource metadata | Applies to 100% | Pass 2% | Worth a look 92% | To fix 0% | Couldn't judge 6% | |
| OpenID Connect discovery | Applies to 100% | Pass 2% | Worth a look 92% | To fix 0% | Couldn't judge 6% | |
| Web Bot Auth (operates a signed bot) | Applies to 100% | Pass <1% | Worth a look 94% | To fix 0% | Couldn't judge 6% | |
| Universal Commerce Protocol manifest | Applies to 3% | Pass 7% | Worth a look 89% | To fix 0% | Couldn't judge 4% | |
| Auth.md agent registration | Applies to 100% | Pass <1% | Worth a look 94% | To fix 0% | Couldn't judge 6% | |
| AI discovery via DNS | Applies to 100% | Pass <1% | Worth a look 99% | To fix 0% | Couldn't judge 1% |
| Check | Applies to | Result | Pass | Worth a look | To fix | Couldn't judge |
|---|---|---|---|---|---|---|
| Core security headers are set | Applies to 100% | Pass 8% | Worth a look 77% | To fix 15% | Couldn't judge 0% | |
| No server version leakage | Applies to 100% | Pass 94% | Worth a look 6% | To fix 0% | Couldn't judge 0% | |
| security.txt is published | Applies to 100% | Pass 4% | Worth a look 93% | To fix 0% | Couldn't judge 3% | |
| Mobile viewport is set | Applies to 100% | Pass 94% | Worth a look 5% | To fix 1% | Couldn't judge 0% | |
| Title fits a search snippet | Applies to >99% | Pass 58% | Worth a look 42% | To fix 0% | Couldn't judge 0% | |
| Description fits a search snippet | Applies to 82% | Pass 65% | Worth a look 35% | To fix 0% | Couldn't judge 0% | |
| Twitter/X card tags | Applies to 100% | Pass 75% | Worth a look 25% | To fix 0% | Couldn't judge 0% | |
| Images are optimised | Applies to 95% | Pass 13% | Worth a look 87% | To fix 0% | Couldn't judge 0% | |
| Analytics is installed | Applies to 100% | Pass 76% | Worth a look 24% | To fix 0% | Couldn't judge 0% | |
| Search Console / Bing verification | Applies to 100% | Pass 81% | Worth a look 18% | To fix 0% | Couldn't judge <1% | |
| A favicon is set | Applies to 100% | Pass 99% | Worth a look 1% | To fix 0% | Couldn't judge 0% | |
| Claims come with figures, quotes or sources | Applies to 71% | Pass 55% | Worth a look 45% | To fix 0% | Couldn't judge <1% | |
| Section headings are phrased as questions | Applies to 68% | Pass 22% | Worth a look 78% | To fix 0% | Couldn't judge <1% | |
| Reading the page is affordable for a machine | Applies to 3% | Pass 77% | Worth a look 23% | To fix 0% | Couldn't judge 0% | |
| No hidden text written for an AI model | Applies to 3% | Pass 99% | Worth a look 1% | To fix 0% | Couldn't judge 0% | |
| Sitemap dates tell a machine what changed | Applies to 2% | Pass 53% | Worth a look 47% | To fix 0% | Couldn't judge 0% | |
| The links in llms.txt resolve | Applies to 1% | Pass 90% | Worth a look 6% | To fix 0% | Couldn't judge 3% | |
| Sensible internal/external link mix | Applies to 98% | Pass 96% | Worth a look 4% | To fix 0% | Couldn't judge <1% |
Based on the sites Bot Appétit has scanned. Most of these sites come from lists we scan for research. Not a random sample of the web.
In November 2026, these were the pairs of checks that sites tended to pass together.
This is an association between checks, not a cause: passing one does not make a site pass the other. It shows what tends to sit together on a site that has been looked after.
Sites that pass the “Resource-discovery Link headers” check are 24.5 times as likely to pass the “Content usage preferences declared” check too. 69% of the sites that pass the first check pass this one, against 3% of the sites that do not.
Sites that pass the “Resource-discovery Link headers” check are 22 times as likely to pass the “Clean content for agents (Markdown)” check too. 73% of the sites that pass the first check pass this one, against 3% of the sites that do not.
Sites that pass the “AI bot rules are explicit and intentional” check are 13 times as likely to pass the “Content usage preferences declared” check too. 19% of the sites that pass the first check pass this one, against 1% of the sites that do not.
Sites that pass the “Clean content for agents (Markdown)” check are 12.5 times as likely to pass the “Content usage preferences declared” check too. 30% of the sites that pass the first check pass this one, against 2% of the sites that do not.
Sites that pass the “A machine-readable published / updated date” check are 9.5 times as likely to pass the “Resource-discovery Link headers” check too. 7% of the sites that pass the first check pass this one, against 1% of the sites that do not.
Sites that pass the “Open Graph tags for sharing” check are 9.5 times as likely to pass the “OAuth authorization-server metadata” check too. 10% of the sites that pass the first check pass this one, against 1% of the sites that do not.
Sites that pass the “Core security headers are set” check are 8.5 times as likely to pass the “security.txt is published” check too. 25% of the sites that pass the first check pass this one, against 3% of the sites that do not.
Sites that pass the “AI bot rules are explicit and intentional” check are 7.5 times as likely to pass the “Resource-discovery Link headers” check too. 6% of the sites that pass the first check pass this one, against 1% of the sites that do not.
Sites that pass the “llms.txt is present and valid” check are 7 times as likely to pass the “Content usage preferences declared” check too. 10% of the sites that pass the first check pass this one, against 1% of the sites that do not.
Sites that pass the “security.txt is published” check are 7 times as likely to pass the “Content usage preferences declared” check too. 20% of the sites that pass the first check pass this one, against 3% of the sites that do not.
Based on the sites Bot Appétit has scanned. Most of these sites come from lists we scan for research. Not a random sample of the web.
In November 2026, here is how the sites we could read did in each category we score.
Advanced and Good practice are on every report but do not count towards the score, so they are marked not scored.
Of the AEO / content results, 54% are passes, 36% are worth a look and 9% need fixing.
Of the AI access results, 80% are passes, 17% are worth a look and 2% need fixing.
Of the AI signals results, 13% are passes, 86% are worth a look and 0% need fixing.
Of the Structured data results, 61% are passes, 12% are worth a look and 27% need fixing.
Of the SEO results, 83% are passes, 9% are worth a look and 6% need fixing.
Of the Links results, 93% are passes, 5% are worth a look and <1% need fixing.
Of the Security results, 99% are passes, <1% are worth a look and 1% need fixing.
Of the Advanced results, 1% are passes, 96% are worth a look and 0% need fixing.
Of the Good practice results, 61% are passes, 37% are worth a look and 1% need fixing.
Based on the sites Bot Appétit has scanned. Most of these sites come from lists we scan for research. Not a random sample of the web.
In November 2026, the most common type of structured data was Organization, on 35% of the sites we could read.
Each type is counted as the type a page publishes in its own right, not when it sits nested inside other markup. The “Organization schema with sameAs” check also counts subtypes and nested markup, so its figure in Every check is a different count. See Every check.
Based on the sites Bot Appétit has scanned. Most of these sites come from lists we scan for research. Not a random sample of the web.
In November 2026, “llms.txt is present and valid” was the emerging standard that sites passed most often: 28% of the sites we could read passed it.
Based on the sites Bot Appétit has scanned. Most of these sites come from lists we scan for research. Not a random sample of the web.
These lines count the sites scanned in each calendar month, so a month's figure can differ from the headline figures above, which use each site's latest scan from the last three months. The “All sites” column is every site scanned that month, including sites added since, so a change there can be a different crowd being scanned.
“Same sites” is every month for the one group of sites scanned in both the first month with a figure and the latest month, so a change there is the sites themselves changing.
Counting every site scanned in November 2026, 7% of the sites we could read passed the “Agent Skills index” check. On the sites scanned in both October 2026 and November 2026, the share went from 9% to 8%.
Line: Same sites Line: All sites (new ones included)
| Month | Applies to | All sites (new ones included) | Same sites |
|---|---|---|---|
| October 2026 | 100% | 1% | 9% |
| November 2026 | 100% | 7% | 8% |
Counting every site scanned in November 2026, 7% of the sites we could read passed the “API catalog” check. On the sites scanned in both October 2026 and November 2026, the share stayed at 7%.
Line: Same sites Line: All sites (new ones included)
| Month | Applies to | All sites (new ones included) | Same sites |
|---|---|---|---|
| October 2026 | 100% | 1% | 7% |
| November 2026 | 100% | 7% | 7% |
Counting every site scanned in November 2026, 4% of the sites we could read passed the “Auth.md agent registration” check. On the sites scanned in both October 2026 and November 2026, the share went from 5% to 4%.
Line: Same sites Line: All sites (new ones included)
| Month | Applies to | All sites (new ones included) | Same sites |
|---|---|---|---|
| October 2026 | 100% | <1% | 5% |
| November 2026 | 100% | 4% | 4% |
Counting every site scanned in November 2026, 0% of the sites we could read passed the “AI discovery via DNS” check. On the sites scanned in both October 2026 and November 2026, the share stayed at 0%.
Line: Same sites Line: All sites (new ones included)
| Month | Applies to | All sites (new ones included) | Same sites |
|---|---|---|---|
| October 2026 | 100% | <1% | 0% |
| November 2026 | 100% | 0% | 0% |
Counting every site scanned in November 2026, 11% of the sites we could read passed the “MCP Server Card” check. On the sites scanned in both October 2026 and November 2026, the share stayed at 12%.
Line: Same sites Line: All sites (new ones included)
| Month | Applies to | All sites (new ones included) | Same sites |
|---|---|---|---|
| October 2026 | 100% | 1% | 12% |
| November 2026 | 100% | 11% | 12% |
Counting every site scanned in November 2026, 15% of the sites we could read passed the “OAuth authorization-server metadata” check. On the sites scanned in both October 2026 and November 2026, the share went from 16% to 15%.
Line: Same sites Line: All sites (new ones included)
| Month | Applies to | All sites (new ones included) | Same sites |
|---|---|---|---|
| October 2026 | 100% | 2% | 16% |
| November 2026 | 100% | 15% | 15% |
Counting every site scanned in November 2026, 9% of the sites we could read passed the “OAuth protected-resource metadata” check. On the sites scanned in both October 2026 and November 2026, the share stayed at 10%.
Line: Same sites Line: All sites (new ones included)
| Month | Applies to | All sites (new ones included) | Same sites |
|---|---|---|---|
| October 2026 | 100% | 2% | 10% |
| November 2026 | 100% | 9% | 10% |
Counting every site scanned in November 2026, 7% of the sites we could read passed the “OpenID Connect discovery” check. On the sites scanned in both October 2026 and November 2026, the share stayed at 7%.
Line: Same sites Line: All sites (new ones included)
| Month | Applies to | All sites (new ones included) | Same sites |
|---|---|---|---|
| October 2026 | 100% | 2% | 7% |
| November 2026 | 100% | 7% | 7% |
Counting every site scanned in November 2026, 1% of the sites we could read passed the “Web Bot Auth (operates a signed bot)” check. On the sites scanned in both October 2026 and November 2026, the share stayed at 1%.
Line: Same sites Line: All sites (new ones included)
| Month | Applies to | All sites (new ones included) | Same sites |
|---|---|---|---|
| October 2026 | 100% | <1% | 1% |
| November 2026 | 100% | 1% | 1% |
Counting every site scanned in November 2026, 25% of the sites we could read passed the “AI bot rules are explicit and intentional” check. On the sites scanned in both October 2026 and November 2026, the share went from 24% to 26%.
Line: Same sites Line: All sites (new ones included)
| Month | Applies to | All sites (new ones included) | Same sites |
|---|---|---|---|
| October 2026 | 100% | 11% | 24% |
| November 2026 | 100% | 25% | 26% |
Counting every site scanned in November 2026, 75% of the sites we could read passed the “AI crawlers aren't blocked” check. On the sites scanned in both August 2026 and November 2026, the share went from 77% to 75%.
Line: Same sites Line: All sites (new ones included)
| Month | Applies to | All sites (new ones included) | Same sites |
|---|---|---|---|
| August 2026 | 100% | 78% | 77% |
| September 2026 | 100% | 81% | 77% |
| October 2026 | 100% | 95% | 77% |
| November 2026 | 100% | 75% | 75% |
Counting every site scanned in November 2026, 50% of the sites we could read passed the “Analytics is installed” check. On the sites scanned in both October 2026 and November 2026, the share went from 49% to 51%.
Line: Same sites Line: All sites (new ones included)
| Month | Applies to | All sites (new ones included) | Same sites |
|---|---|---|---|
| October 2026 | 100% | 77% | 49% |
| November 2026 | 100% | 50% | 51% |
Counting every site scanned in November 2026, 97% of the sites where it applies (95% of the sites we could read) passed the “Descriptive anchor text” check. On the sites scanned in both October 2026 and November 2026, the share stayed at 98%.
Line: Same sites Line: All sites (new ones included)
| Month | Applies to | All sites (new ones included) | Same sites |
|---|---|---|---|
| October 2026 | 98% | 99% | 98% |
| November 2026 | 95% | 97% | 98% |
Counting every site scanned in November 2026, 53% of the sites we could read passed the “Author / publisher is clear” check. On the sites scanned in both October 2026 and November 2026, the share stayed at 53%.
Line: Same sites Line: All sites (new ones included)
| Month | Applies to | All sites (new ones included) | Same sites |
|---|---|---|---|
| October 2026 | 100% | 50% | 53% |
| November 2026 | 100% | 53% | 53% |
Counting every site scanned in November 2026, 85% of the sites where it applies (94% of the sites we could read) passed the “No broken links” check. On the sites scanned in both October 2026 and November 2026, the share went from 91% to 88%.
Line: Same sites Line: All sites (new ones included)
| Month | Applies to | All sites (new ones included) | Same sites |
|---|---|---|---|
| October 2026 | 98% | 88% | 91% |
| November 2026 | 94% | 85% | 88% |
Counting every site scanned in November 2026, 83% of the sites we could read passed the “Caching or validation headers are set” check. On the sites scanned in both October 2026 and November 2026, the share stayed at 85%.
Line: Same sites Line: All sites (new ones included)
| Month | Applies to | All sites (new ones included) | Same sites |
|---|---|---|---|
| October 2026 | 100% | 96% | 85% |
| November 2026 | 100% | 83% | 85% |
Counting every site scanned in November 2026, 72% of the sites we could read passed the “This page declares its canonical URL” check. On the sites scanned in both October 2026 and November 2026, the share went from 72% to 73%.
Line: Same sites Line: All sites (new ones included)
| Month | Applies to | All sites (new ones included) | Same sites |
|---|---|---|---|
| October 2026 | 100% | 57% | 72% |
| November 2026 | 100% | 72% | 73% |
Counting every site scanned in November 2026, 82% of the sites we could read passed the “The site settles on one host (www vs non-www)” check. On the sites scanned in both October 2026 and November 2026, the share went from 80% to 81%.
Line: Same sites Line: All sites (new ones included)
| Month | Applies to | All sites (new ones included) | Same sites |
|---|---|---|---|
| October 2026 | 100% | 89% | 80% |
| November 2026 | 100% | 82% | 81% |
Counting every site scanned in November 2026, 86% of the sites we could read passed the “Content is scannable in self-contained chunks” check. On the sites scanned in both October 2026 and November 2026, the share went from 85% to 86%.
Line: Same sites Line: All sites (new ones included)
| Month | Applies to | All sites (new ones included) | Same sites |
|---|---|---|---|
| October 2026 | 100% | 95% | 85% |
| November 2026 | 100% | 86% | 86% |
Counting every site scanned in November 2026, 93% of the sites we could read passed the “Your answer is in the HTML” check. On the sites scanned in both October 2026 and November 2026, the share went from 91% to 92%.
Line: Same sites Line: All sites (new ones included)
| Month | Applies to | All sites (new ones included) | Same sites |
|---|---|---|---|
| October 2026 | 100% | 96% | 91% |
| November 2026 | 100% | 93% | 92% |
Counting every site scanned in November 2026, 12% of the sites we could read passed the “Content usage preferences declared” check. On the sites scanned in both October 2026 and November 2026, the share went from 9% to 11%.
Line: Same sites Line: All sites (new ones included)
| Month | Applies to | All sites (new ones included) | Same sites |
|---|---|---|---|
| October 2026 | 100% | 3% | 9% |
| November 2026 | 100% | 12% | 11% |
Counting every site scanned in November 2026, 83% of the sites we could read passed the “Missing pages return a real 404” check. On the sites scanned in both October 2026 and November 2026, the share went from 84% to 81%.
Line: Same sites Line: All sites (new ones included)
| Month | Applies to | All sites (new ones included) | Same sites |
|---|---|---|---|
| October 2026 | 100% | 96% | 84% |
| November 2026 | 100% | 83% | 81% |
Counting every site scanned in November 2026, 47% of the sites where it applies (20% of the sites we could read) passed the “FAQ / Q&A schema” check. On the sites scanned in both September 2026 and October 2026, the share went from 44% to 51%.
Line: Same sites Line: All sites (new ones included)
| Month | Applies to | All sites (new ones included) | Same sites |
|---|---|---|---|
| August 2026 | 15% | 30% | — |
| September 2026 | 13% | 43% | 44% |
| October 2026 | 20% | 47% | 51% |
| November 2026 | 9% | — | — |
Counting every site scanned in November 2026, 96% of the sites we could read passed the “A favicon is set” check. On the sites scanned in both October 2026 and November 2026, the share stayed at 96%.
Line: Same sites Line: All sites (new ones included)
| Month | Applies to | All sites (new ones included) | Same sites |
|---|---|---|---|
| October 2026 | 100% | 99% | 96% |
| November 2026 | 100% | 96% | 96% |
Counting every site scanned in November 2026, 19% of the sites we could read passed the “A machine-readable published / updated date” check. On the sites scanned in both October 2026 and November 2026, the share went from 18% to 19%.
Line: Same sites Line: All sites (new ones included)
| Month | Applies to | All sites (new ones included) | Same sites |
|---|---|---|---|
| October 2026 | 100% | 8% | 18% |
| November 2026 | 100% | 19% | 19% |
Counting every site scanned in November 2026, 75% of the sites we could read passed the “Logical heading order” check. On the sites scanned in both October 2026 and November 2026, the share went from 71% to 74%.
Line: Same sites Line: All sites (new ones included)
| Month | Applies to | All sites (new ones included) | Same sites |
|---|---|---|---|
| October 2026 | 100% | 64% | 71% |
| November 2026 | 100% | 75% | 74% |
Counting every site scanned in November 2026, 95% of the sites we could read passed the “Reached without a redirect chain” check. On the sites scanned in both October 2026 and November 2026, the share went from 97% to 96%.
Line: Same sites Line: All sites (new ones included)
| Month | Applies to | All sites (new ones included) | Same sites |
|---|---|---|---|
| October 2026 | 100% | 99% | 97% |
| November 2026 | 100% | 95% | 96% |
Counting every site scanned in November 2026, 99% of the sites we could read passed the “Served over a secure HTTPS connection” check. On the sites scanned in both October 2026 and November 2026, the share stayed at 99%.
Line: Same sites Line: All sites (new ones included)
| Month | Applies to | All sites (new ones included) | Same sites |
|---|---|---|---|
| October 2026 | 100% | >99% | 99% |
| November 2026 | 100% | 99% | 99% |
Counting every site scanned in November 2026, 82% of the sites we could read passed the “HTTP redirects to HTTPS” check. On the sites scanned in both October 2026 and November 2026, the share went from 81% to 82%.
Line: Same sites Line: All sites (new ones included)
| Month | Applies to | All sites (new ones included) | Same sites |
|---|---|---|---|
| October 2026 | 100% | 96% | 81% |
| November 2026 | 100% | 82% | 82% |
Counting every site scanned in November 2026, 89% of the sites where it applies (83% of the sites we could read) passed the “Images have descriptive alt text” check. On the sites scanned in both October 2026 and November 2026, the share stayed at 87%.
Line: Same sites Line: All sites (new ones included)
| Month | Applies to | All sites (new ones included) | Same sites |
|---|---|---|---|
| October 2026 | 96% | 98% | 87% |
| November 2026 | 83% | 89% | 87% |
Counting every site scanned in November 2026, 40% of the sites where it applies (83% of the sites we could read) passed the “Images are optimised” check. On the sites scanned in both October 2026 and November 2026, the share went from 38% to 39%.
Line: Same sites Line: All sites (new ones included)
| Month | Applies to | All sites (new ones included) | Same sites |
|---|---|---|---|
| October 2026 | 96% | 11% | 38% |
| November 2026 | 83% | 40% | 39% |
Counting every site scanned in November 2026, 57% of the sites we could read passed the “Structured data is present” check. On the sites scanned in both August 2026 and November 2026, the share went from 53% to 57%.
Line: Same sites Line: All sites (new ones included)
| Month | Applies to | All sites (new ones included) | Same sites |
|---|---|---|---|
| August 2026 | 100% | 57% | 53% |
| September 2026 | 100% | 61% | 54% |
| October 2026 | 100% | 55% | 58% |
| November 2026 | 100% | 57% | 57% |
Counting every site scanned in November 2026, 64% of the sites we could read passed the “Topic is consistent across title, H1 and description” check. On the sites scanned in both October 2026 and November 2026, the share went from 61% to 64%.
Line: Same sites Line: All sites (new ones included)
| Month | Applies to | All sites (new ones included) | Same sites |
|---|---|---|---|
| October 2026 | 100% | 67% | 61% |
| November 2026 | 100% | 64% | 64% |
Counting every site scanned in November 2026, 89% of the sites we could read passed the “Language and charset declared” check. On the sites scanned in both October 2026 and November 2026, the share stayed at 88%.
Line: Same sites Line: All sites (new ones included)
| Month | Applies to | All sites (new ones included) | Same sites |
|---|---|---|---|
| October 2026 | 100% | 84% | 88% |
| November 2026 | 100% | 89% | 88% |
Counting every site scanned in November 2026, 10% of the sites we could read passed the “Resource-discovery Link headers” check. On the sites scanned in both October 2026 and November 2026, the share stayed at 11%.
Line: Same sites Line: All sites (new ones included)
| Month | Applies to | All sites (new ones included) | Same sites |
|---|---|---|---|
| October 2026 | 100% | 1% | 11% |
| November 2026 | 100% | 10% | 11% |
Counting every site scanned in November 2026, 92% of the sites where it applies (94% of the sites we could read) passed the “Sensible internal/external link mix” check. On the sites scanned in both October 2026 and November 2026, the share stayed at 92%.
Line: Same sites Line: All sites (new ones included)
| Month | Applies to | All sites (new ones included) | Same sites |
|---|---|---|---|
| October 2026 | 98% | 96% | 92% |
| November 2026 | 94% | 92% | 92% |
Counting every site scanned in November 2026, 34% of the sites we could read passed the “llms.txt is present and valid” check. On the sites scanned in both August 2026 and November 2026, the share went from 32% to 35%.
Line: Same sites Line: All sites (new ones included)
| Month | Applies to | All sites (new ones included) | Same sites |
|---|---|---|---|
| August 2026 | 100% | 30% | 32% |
| September 2026 | 100% | 28% | 31% |
| October 2026 | 100% | 29% | 35% |
| November 2026 | 100% | 34% | 35% |
Counting every site scanned in November 2026, 14% of the sites we could read passed the “Clean content for agents (Markdown)” check. On the sites scanned in both October 2026 and November 2026, the share went from 15% to 14%.
Line: Same sites Line: All sites (new ones included)
| Month | Applies to | All sites (new ones included) | Same sites |
|---|---|---|---|
| October 2026 | 100% | 4% | 15% |
| November 2026 | 100% | 14% | 14% |
Counting every site scanned in November 2026, 86% of the sites we could read passed the “Has a meta description” check. On the sites scanned in both October 2026 and November 2026, the share went from 85% to 86%.
Line: Same sites Line: All sites (new ones included)
| Month | Applies to | All sites (new ones included) | Same sites |
|---|---|---|---|
| October 2026 | 100% | 94% | 85% |
| November 2026 | 100% | 86% | 86% |
Counting every site scanned in November 2026, 96% of the sites we could read passed the “No meta-refresh redirect” check. On the sites scanned in both October 2026 and November 2026, the share stayed at 97%.
Line: Same sites Line: All sites (new ones included)
| Month | Applies to | All sites (new ones included) | Same sites |
|---|---|---|---|
| October 2026 | 100% | >99% | 97% |
| November 2026 | 100% | 96% | 97% |
Counting every site scanned in November 2026, 99% of the sites we could read passed the “Not accidentally set to noindex” check. On the sites scanned in both October 2026 and November 2026, the share stayed at 100%.
Line: Same sites Line: All sites (new ones included)
| Month | Applies to | All sites (new ones included) | Same sites |
|---|---|---|---|
| October 2026 | 100% | 99% | 100% |
| November 2026 | 100% | 99% | 100% |
Counting every site scanned in November 2026, 99% of the sites we could read passed the “No mixed (insecure) content” check. On the sites scanned in both October 2026 and November 2026, the share stayed at 99%.
Line: Same sites Line: All sites (new ones included)
| Month | Applies to | All sites (new ones included) | Same sites |
|---|---|---|---|
| October 2026 | 100% | 99% | 99% |
| November 2026 | 100% | 99% | 99% |
Counting every site scanned in November 2026, 60% of the sites we could read passed the “Open Graph tags for sharing” check. On the sites scanned in both October 2026 and November 2026, the share went from 60% to 59%.
Line: Same sites Line: All sites (new ones included)
| Month | Applies to | All sites (new ones included) | Same sites |
|---|---|---|---|
| October 2026 | 100% | 18% | 60% |
| November 2026 | 100% | 60% | 59% |
Counting every site scanned in November 2026, 31% of the sites we could read passed the “Organization schema with sameAs” check. On the sites scanned in both August 2026 and November 2026, the share went from 30% to 31%.
Line: Same sites Line: All sites (new ones included)
| Month | Applies to | All sites (new ones included) | Same sites |
|---|---|---|---|
| August 2026 | 100% | 33% | 30% |
| September 2026 | 100% | 31% | 29% |
| October 2026 | 100% | 34% | 31% |
| November 2026 | 100% | 31% | 31% |
Counting every site scanned in November 2026, 81% of the sites where it applies (88% of the sites we could read) passed the “Links don't point at redirects” check. On the sites scanned in both October 2026 and November 2026, the share stayed at 84%.
Line: Same sites Line: All sites (new ones included)
| Month | Applies to | All sites (new ones included) | Same sites |
|---|---|---|---|
| October 2026 | 96% | 95% | 84% |
| November 2026 | 88% | 81% | 84% |
Counting every site scanned in November 2026, 88% of the sites we could read passed the “robots.txt is present and not over-blocking” check. On the sites scanned in both October 2026 and November 2026, the share stayed at 88%.
Line: Same sites Line: All sites (new ones included)
| Month | Applies to | All sites (new ones included) | Same sites |
|---|---|---|---|
| October 2026 | 100% | 92% | 88% |
| November 2026 | 100% | 88% | 88% |
Counting every site scanned in November 2026, 100% of the sites we could read passed the “Not flagged for malware or phishing” check. On the sites scanned in both October 2026 and November 2026, the share stayed at 100%.
Line: Same sites Line: All sites (new ones included)
| Month | Applies to | All sites (new ones included) | Same sites |
|---|---|---|---|
| October 2026 | >99% | 100% | 100% |
| November 2026 | 100% | 100% | 100% |
Counting every site scanned in November 2026, 82% of the sites we could read passed the “Search Console / Bing verification” check. On the sites scanned in both October 2026 and November 2026, the share stayed at 86%.
Line: Same sites Line: All sites (new ones included)
| Month | Applies to | All sites (new ones included) | Same sites |
|---|---|---|---|
| October 2026 | 100% | 82% | 86% |
| November 2026 | 100% | 82% | 86% |
Counting every site scanned in November 2026, 21% of the sites we could read passed the “Core security headers are set” check. On the sites scanned in both October 2026 and November 2026, the share stayed at 24%.
Line: Same sites Line: All sites (new ones included)
| Month | Applies to | All sites (new ones included) | Same sites |
|---|---|---|---|
| October 2026 | 100% | 6% | 24% |
| November 2026 | 100% | 21% | 24% |
Counting every site scanned in November 2026, 21% of the sites we could read passed the “security.txt is published” check. On the sites scanned in both October 2026 and November 2026, the share went from 24% to 23%.
Line: Same sites Line: All sites (new ones included)
| Month | Applies to | All sites (new ones included) | Same sites |
|---|---|---|---|
| October 2026 | 100% | 4% | 24% |
| November 2026 | 100% | 21% | 23% |
Counting every site scanned in November 2026, 71% of the sites we could read passed the “Semantic HTML landmarks” check. On the sites scanned in both October 2026 and November 2026, the share went from 70% to 71%.
Line: Same sites Line: All sites (new ones included)
| Month | Applies to | All sites (new ones included) | Same sites |
|---|---|---|---|
| October 2026 | 100% | 49% | 70% |
| November 2026 | 100% | 71% | 71% |
Counting every site scanned in November 2026, 84% of the sites we could read passed the “No server version leakage” check. On the sites scanned in both October 2026 and November 2026, the share stayed at 84%.
Line: Same sites Line: All sites (new ones included)
| Month | Applies to | All sites (new ones included) | Same sites |
|---|---|---|---|
| October 2026 | 100% | 95% | 84% |
| November 2026 | 100% | 84% | 84% |
Counting every site scanned in November 2026, 71% of the sites we could read passed the “The page has an H1” check. On the sites scanned in both October 2026 and November 2026, the share went from 67% to 68%.
Line: Same sites Line: All sites (new ones included)
| Month | Applies to | All sites (new ones included) | Same sites |
|---|---|---|---|
| October 2026 | 100% | 90% | 67% |
| November 2026 | 100% | 71% | 68% |
Counting every site scanned in November 2026, 66% of the sites we could read passed the “XML sitemap is present and referenced” check. On the sites scanned in both August 2026 and November 2026, the share went from 68% to 69%.
Line: Same sites Line: All sites (new ones included)
| Month | Applies to | All sites (new ones included) | Same sites |
|---|---|---|---|
| August 2026 | 100% | 69% | 68% |
| September 2026 | 100% | 71% | 69% |
| October 2026 | 100% | 77% | 69% |
| November 2026 | 100% | 66% | 69% |
Counting every site scanned in November 2026, 99% of the sites we could read passed the “Has a title tag” check. On the sites scanned in both October 2026 and November 2026, the share stayed at 99%.
Line: Same sites Line: All sites (new ones included)
| Month | Applies to | All sites (new ones included) | Same sites |
|---|---|---|---|
| October 2026 | 100% | >99% | 99% |
| November 2026 | 100% | 99% | 99% |
Counting every site scanned in November 2026, 70% of the sites we could read passed the “Twitter/X card tags” check. On the sites scanned in both October 2026 and November 2026, the share stayed at 69%.
Line: Same sites Line: All sites (new ones included)
| Month | Applies to | All sites (new ones included) | Same sites |
|---|---|---|---|
| October 2026 | 100% | 75% | 69% |
| November 2026 | 100% | 70% | 69% |
Counting every site scanned in November 2026, 79% of the sites we could read passed the “Mobile viewport is set” check. On the sites scanned in both October 2026 and November 2026, the share went from 76% to 77%.
Line: Same sites Line: All sites (new ones included)
| Month | Applies to | All sites (new ones included) | Same sites |
|---|---|---|---|
| October 2026 | 100% | 96% | 76% |
| November 2026 | 100% | 79% | 77% |
Counting every site scanned in November 2026, 98% of the sites where it applies (56% of the sites we could read) passed the “Structured data is valid” check. On the sites scanned in both October 2026 and November 2026, the share stayed at 98%.
Line: Same sites Line: All sites (new ones included)
| Month | Applies to | All sites (new ones included) | Same sites |
|---|---|---|---|
| October 2026 | 55% | 97% | 98% |
| November 2026 | 56% | 98% | 98% |
Counting every site scanned in November 2026, 87% of the sites where it applies (56% of the sites we could read) passed the “Right schema type for the page” check. On the sites scanned in both October 2026 and November 2026, the share stayed at 85%.
Line: Same sites Line: All sites (new ones included)
| Month | Applies to | All sites (new ones included) | Same sites |
|---|---|---|---|
| October 2026 | 55% | 96% | 85% |
| November 2026 | 56% | 87% | 85% |
Counting every site scanned in November 2026, 45% of the sites where it applies (99% of the sites we could read) passed the “Title fits a search snippet” check. On the sites scanned in both October 2026 and November 2026, the share stayed at 46%.
Line: Same sites Line: All sites (new ones included)
| Month | Applies to | All sites (new ones included) | Same sites |
|---|---|---|---|
| October 2026 | >99% | 60% | 46% |
| November 2026 | 99% | 45% | 46% |
Counting every site scanned in November 2026, 30% of the sites where it applies (2% of the sites we could read) passed the “Breadcrumb structured data” check.
Line: Same sites Line: All sites (new ones included)
| Month | Applies to | All sites (new ones included) | Same sites |
|---|---|---|---|
| August 2026 | 9% | — | — |
| September 2026 | 17% | 29% | — |
| October 2026 | 2% | 30% | 30% |
| November 2026 | 7% | — | — |
Counting every site scanned in November 2026, 6% of the sites we could read passed the “AI catalog” check. On the sites scanned in both October 2026 and November 2026, the share stayed at 6%.
Line: Same sites Line: All sites (new ones included)
| Month | Applies to | All sites (new ones included) | Same sites |
|---|---|---|---|
| October 2026 | 100% | 1% | 6% |
| November 2026 | 100% | 6% | 6% |
Counting every site scanned in November 2026, 92% of the sites we could read passed the “Your content survives without JavaScript” check. On the sites scanned in both October 2026 and November 2026, the share stayed at 91%.
Line: Same sites Line: All sites (new ones included)
| Month | Applies to | All sites (new ones included) | Same sites |
|---|---|---|---|
| October 2026 | 100% | 97% | 91% |
| November 2026 | 100% | 92% | 91% |
Counting every site scanned in November 2026, 4% of the sites we could read passed the “A2A Agent Card” check. On the sites scanned in both October 2026 and November 2026, the share stayed at 4%.
Line: Same sites Line: All sites (new ones included)
| Month | Applies to | All sites (new ones included) | Same sites |
|---|---|---|---|
| October 2026 | >99% | <1% | 4% |
| November 2026 | 100% | 4% | 4% |
Counting every site scanned in November 2026, 0% of the sites we could read passed the “AI usage preferences (Content-Usage)” check. On the sites scanned in both October 2026 and November 2026, the share stayed at 0%.
Line: Same sites Line: All sites (new ones included)
| Month | Applies to | All sites (new ones included) | Same sites |
|---|---|---|---|
| October 2026 | >99% | <1% | 0% |
| November 2026 | 100% | 0% | 0% |
Counting every site scanned in November 2026, 7% of the sites we could read passed the “Markdown version linked from the page” check. On the sites scanned in both October 2026 and November 2026, the share stayed at 8%.
Line: Same sites Line: All sites (new ones included)
| Month | Applies to | All sites (new ones included) | Same sites |
|---|---|---|---|
| October 2026 | >99% | 1% | 8% |
| November 2026 | 100% | 7% | 8% |
Counting every site scanned in November 2026, 0% of the sites we could read passed the “Licensing terms for AI (RSL)” check. On the sites scanned in both October 2026 and November 2026, the share stayed at 0%.
Line: Same sites Line: All sites (new ones included)
| Month | Applies to | All sites (new ones included) | Same sites |
|---|---|---|---|
| October 2026 | >99% | <1% | 0% |
| November 2026 | 100% | 0% | 0% |
Counting every site scanned in November 2026, 0% of the sites we could read passed the “Text-and-data-mining reservation (TDMRep)” check. On the sites scanned in both October 2026 and November 2026, the share stayed at 0%.
Line: Same sites Line: All sites (new ones included)
| Month | Applies to | All sites (new ones included) | Same sites |
|---|---|---|---|
| October 2026 | >99% | <1% | 0% |
| November 2026 | 100% | 0% | 0% |
Counting every site scanned in November 2026, 3% of the sites we could read passed the “WebMCP tools in the page” check. On the sites scanned in both October 2026 and November 2026, the share stayed at 3%.
Line: Same sites Line: All sites (new ones included)
| Month | Applies to | All sites (new ones included) | Same sites |
|---|---|---|---|
| October 2026 | >99% | <1% | 3% |
| November 2026 | 100% | 3% | 3% |
Counting every site scanned in November 2026, 52% of the sites where it applies (94% of the sites we could read) passed the “Buttons, links and fields have names” check. On the sites scanned in both October 2026 and November 2026, the share stayed at 54%.
Line: Same sites Line: All sites (new ones included)
| Month | Applies to | All sites (new ones included) | Same sites |
|---|---|---|---|
| October 2026 | 98% | 30% | 54% |
| November 2026 | 94% | 52% | 54% |
Counting every site scanned in November 2026, 56% of the sites where it applies (72% of the sites we could read) passed the “Claims come with figures, quotes or sources” check. On the sites scanned in both October 2026 and November 2026, the share went from 60% to 59%.
Line: Same sites Line: All sites (new ones included)
| Month | Applies to | All sites (new ones included) | Same sites |
|---|---|---|---|
| October 2026 | 80% | 55% | 60% |
| November 2026 | 72% | 56% | 59% |
Counting every site scanned in November 2026, 95% of the sites we could read passed the “Your page's HTML isn't oversized” check. On the sites scanned in both October 2026 and November 2026, the share stayed at 96%.
Line: Same sites Line: All sites (new ones included)
| Month | Applies to | All sites (new ones included) | Same sites |
|---|---|---|---|
| October 2026 | >99% | 99% | 96% |
| November 2026 | 100% | 95% | 96% |
Counting every site scanned in November 2026, 66% of the sites where it applies (86% of the sites we could read) passed the “Description fits a search snippet” check. On the sites scanned in both October 2026 and November 2026, the share went from 63% to 64%.
Line: Same sites Line: All sites (new ones included)
| Month | Applies to | All sites (new ones included) | Same sites |
|---|---|---|---|
| October 2026 | 94% | 65% | 63% |
| November 2026 | 86% | 66% | 64% |
Counting every site scanned in November 2026, 31% of the sites where it applies (65% of the sites we could read) passed the “Section headings are phrased as questions” check. On the sites scanned in both October 2026 and November 2026, the share stayed at 33%.
Line: Same sites Line: All sites (new ones included)
| Month | Applies to | All sites (new ones included) | Same sites |
|---|---|---|---|
| October 2026 | 77% | 22% | 33% |
| November 2026 | 65% | 31% | 33% |
Counting every site scanned in November 2026, 91% of the sites we could read passed the “Your page arrives quickly” check. On the sites scanned in both October 2026 and November 2026, the share went from 94% to 93%.
Line: Same sites Line: All sites (new ones included)
| Month | Applies to | All sites (new ones included) | Same sites |
|---|---|---|---|
| October 2026 | >99% | 97% | 94% |
| November 2026 | 100% | 91% | 93% |
Counting every site scanned in November 2026, 93% of the sites we could read passed the “Engines are allowed to quote the page” check. On the sites scanned in both October 2026 and November 2026, the share stayed at 93%.
Line: Same sites Line: All sites (new ones included)
| Month | Applies to | All sites (new ones included) | Same sites |
|---|---|---|---|
| October 2026 | >99% | 99% | 93% |
| November 2026 | 100% | 93% | 93% |
Counting every site scanned in November 2026, 90% of the sites where it applies (94% of the sites we could read) passed the “Links are real links” check. On the sites scanned in both October 2026 and November 2026, the share went from 90% to 91%.
Line: Same sites Line: All sites (new ones included)
| Month | Applies to | All sites (new ones included) | Same sites |
|---|---|---|---|
| October 2026 | 98% | 93% | 90% |
| November 2026 | 94% | 90% | 91% |
Counting every site scanned in November 2026, 33% of the sites we could read published Organization structured data as a type of its own. On the sites scanned in both August 2026 and November 2026, the share went from 27% to 30%.
Line: Same sites Line: All sites (new ones included)
| Month | All sites (new ones included) | Same sites |
|---|---|---|
| August 2026 | 30% | 27% |
| September 2026 | 35% | 29% |
| October 2026 | 36% | 31% |
| November 2026 | 33% | 30% |
Counting every site scanned in November 2026, 36% of the sites we could read published WebSite structured data as a type of its own. On the sites scanned in both August 2026 and November 2026, the share went from 35% to 34%.
Line: Same sites Line: All sites (new ones included)
| Month | All sites (new ones included) | Same sites |
|---|---|---|
| August 2026 | 33% | 35% |
| September 2026 | 38% | 33% |
| October 2026 | 27% | 34% |
| November 2026 | 36% | 34% |
Counting every site scanned in November 2026, 20% of the sites we could read published WebPage structured data as a type of its own. On the sites scanned in both August 2026 and November 2026, the share went from 17% to 19%.
Line: Same sites Line: All sites (new ones included)
| Month | All sites (new ones included) | Same sites |
|---|---|---|
| August 2026 | 21% | 17% |
| September 2026 | 23% | 18% |
| October 2026 | 18% | 19% |
| November 2026 | 20% | 19% |
Counting every site scanned in November 2026, 7% of the sites we could read published SoftwareApplication structured data as a type of its own. On the sites scanned in both August 2026 and November 2026, the share went from 6% to 7%.
Line: Same sites Line: All sites (new ones included)
| Month | All sites (new ones included) | Same sites |
|---|---|---|
| August 2026 | 7% | 6% |
| September 2026 | 5% | 7% |
| October 2026 | 8% | 7% |
| November 2026 | 7% | 7% |
Counting every site scanned in November 2026, 2% of the sites we could read published Service structured data as a type of its own. On the sites scanned in both August 2026 and November 2026, the share stayed at 2%.
Line: Same sites Line: All sites (new ones included)
| Month | All sites (new ones included) | Same sites |
|---|---|---|
| August 2026 | 2% | 2% |
| September 2026 | 1% | 2% |
| October 2026 | 2% | 2% |
| November 2026 | 2% | 2% |
Counting every site scanned in November 2026, 3% of the sites we could read published FAQPage structured data as a type of its own. On the sites scanned in both August 2026 and November 2026, the share stayed at 2%.
Line: Same sites Line: All sites (new ones included)
| Month | All sites (new ones included) | Same sites |
|---|---|---|
| August 2026 | 4% | 2% |
| September 2026 | 6% | 3% |
| October 2026 | 7% | 3% |
| November 2026 | 3% | 2% |
Counting every site scanned in November 2026, 7% of the sites we could read published Article structured data as a type of its own. On the sites scanned in both August 2026 and November 2026, the share stayed at 6%.
Line: Same sites Line: All sites (new ones included)
| Month | All sites (new ones included) | Same sites |
|---|---|---|
| August 2026 | 3% | 6% |
| September 2026 | 4% | 6% |
| October 2026 | 1% | 6% |
| November 2026 | 7% | 6% |
Counting every site scanned in November 2026, 4% of the sites we could read published TechArticle structured data as a type of its own. On the sites scanned in both August 2026 and November 2026, the share went from 3% to 4%.
Line: Same sites Line: All sites (new ones included)
| Month | All sites (new ones included) | Same sites |
|---|---|---|
| August 2026 | 1% | 3% |
| September 2026 | 1% | 4% |
| October 2026 | <1% | 4% |
| November 2026 | 4% | 4% |
Counting every site scanned in November 2026, 6% of the sites we could read published NewsMediaOrganization structured data as a type of its own. On the sites scanned in both August 2026 and November 2026, the share went from 8% to 6%.
Line: Same sites Line: All sites (new ones included)
| Month | All sites (new ones included) | Same sites |
|---|---|---|
| August 2026 | 4% | 8% |
| September 2026 | 3% | 6% |
| October 2026 | <1% | 6% |
| November 2026 | 6% | 6% |
Counting every site scanned in November 2026, 2% of the sites we could read published ItemList structured data as a type of its own. On the sites scanned in both August 2026 and November 2026, the share stayed at 2%.
Line: Same sites Line: All sites (new ones included)
| Month | All sites (new ones included) | Same sites |
|---|---|---|
| August 2026 | 2% | 2% |
| September 2026 | 3% | 3% |
| October 2026 | 2% | 3% |
| November 2026 | 2% | 2% |
Counting every site scanned in November 2026, 5% of the sites we could read published Person structured data as a type of its own. On the sites scanned in both August 2026 and November 2026, the share stayed at 4%.
Line: Same sites Line: All sites (new ones included)
| Month | All sites (new ones included) | Same sites |
|---|---|---|
| August 2026 | 7% | 4% |
| September 2026 | 7% | 4% |
| October 2026 | 3% | 4% |
| November 2026 | 5% | 4% |
Counting every site scanned in November 2026, 7% of the sites we could read published BreadcrumbList structured data as a type of its own. On the sites scanned in both August 2026 and November 2026, the share went from 5% to 7%.
Line: Same sites Line: All sites (new ones included)
| Month | All sites (new ones included) | Same sites |
|---|---|---|
| August 2026 | 7% | 5% |
| September 2026 | 15% | 6% |
| October 2026 | 5% | 7% |
| November 2026 | 7% | 7% |
Counting every site scanned in November 2026, 0% of the sites we could read published Place structured data as a type of its own. On the sites scanned in both August 2026 and November 2026, the share stayed at 0%.
Line: Same sites Line: All sites (new ones included)
| Month | All sites (new ones included) | Same sites |
|---|---|---|
| August 2026 | <1% | 0% |
| September 2026 | 2% | 0% |
| October 2026 | 1% | 0% |
| November 2026 | 0% | 0% |
Counting every site scanned in November 2026, 4% of the sites we could read published ImageObject structured data as a type of its own. On the sites scanned in both August 2026 and November 2026, the share went from 2% to 3%.
Line: Same sites Line: All sites (new ones included)
| Month | All sites (new ones included) | Same sites |
|---|---|---|
| August 2026 | 4% | 2% |
| September 2026 | 9% | 2% |
| October 2026 | 3% | 3% |
| November 2026 | 4% | 3% |
Counting every site scanned in November 2026, 0% of the sites we could read published LocalBusiness structured data as a type of its own. On the sites scanned in both August 2026 and November 2026, the share stayed at 0%.
Line: Same sites Line: All sites (new ones included)
| Month | All sites (new ones included) | Same sites |
|---|---|---|
| August 2026 | 2% | 0% |
| September 2026 | 4% | 0% |
| October 2026 | 5% | 0% |
| November 2026 | 0% | 0% |
Counting every site scanned in November 2026, 0% of the sites we could read published ProfessionalService structured data as a type of its own. On the sites scanned in both August 2026 and November 2026, the share stayed at 0%.
Line: Same sites Line: All sites (new ones included)
| Month | All sites (new ones included) | Same sites |
|---|---|---|
| August 2026 | 3% | 0% |
| September 2026 | 2% | 0% |
| October 2026 | 3% | 0% |
| November 2026 | 0% | 0% |
Counting every site scanned in November 2026, 6% of the sites we could read published CollectionPage structured data as a type of its own. On the sites scanned in both August 2026 and November 2026, the share stayed at 6%.
Line: Same sites Line: All sites (new ones included)
| Month | All sites (new ones included) | Same sites |
|---|---|---|
| August 2026 | 4% | 6% |
| September 2026 | 3% | 6% |
| October 2026 | <1% | 6% |
| November 2026 | 6% | 6% |
Counting every site scanned in November 2026, 2% of the sites we could read published Corporation structured data as a type of its own. On the sites scanned in both August 2026 and November 2026, the share stayed at 2%.
Line: Same sites Line: All sites (new ones included)
| Month | All sites (new ones included) | Same sites |
|---|---|---|
| August 2026 | 2% | 2% |
| September 2026 | 1% | 2% |
| October 2026 | 2% | 2% |
| November 2026 | 2% | 2% |
Counting every site scanned in November 2026, 0% of the sites we could read published ProfilePage structured data as a type of its own. On the sites scanned in both August 2026 and November 2026, the share stayed at 0%.
Line: Same sites Line: All sites (new ones included)
| Month | All sites (new ones included) | Same sites |
|---|---|---|
| August 2026 | 1% | 0% |
| September 2026 | 1% | 0% |
| October 2026 | 1% | 0% |
| November 2026 | 0% | 0% |
Counting every site scanned in November 2026, 0% of the sites we could read published NewsArticle structured data as a type of its own. On the sites scanned in both August 2026 and November 2026, the share stayed at 0%.
Line: Same sites Line: All sites (new ones included)
| Month | All sites (new ones included) | Same sites |
|---|---|---|
| August 2026 | <1% | 0% |
| September 2026 | 2% | 0% |
| October 2026 | <1% | 0% |
| November 2026 | 0% | 0% |
Counting every site scanned in November 2026, 0% of the sites we could read published SiteNavigationElement structured data as a type of its own. On the sites scanned in both August 2026 and November 2026, the share stayed at 0%.
Line: Same sites Line: All sites (new ones included)
| Month | All sites (new ones included) | Same sites |
|---|---|---|
| August 2026 | 0% | 0% |
| September 2026 | 1% | 0% |
| October 2026 | <1% | 0% |
| November 2026 | 0% | 0% |
Counting every site scanned in November 2026, 34% of the sites we scanned scored 91–100. On the sites scanned in both October 2026 and November 2026, the share went from 36% to 35%.
Line: Same sites Line: All sites (new ones included)
| Month | All sites (new ones included) | Same sites |
|---|---|---|
| October 2026 | 42% | 36% |
| November 2026 | 34% | 35% |
Counting every site scanned in November 2026, 27% of the sites we scanned scored 81–90.
Line: Same sites Line: All sites (new ones included)
| Month | All sites (new ones included) | Same sites |
|---|---|---|
| October 2026 | 35% | — |
| November 2026 | 27% | 27% |
Counting every site scanned in November 2026, 17% of the sites we scanned turned our scanner away. On the sites scanned in both October 2026 and November 2026, the share stayed at 18%.
Line: Same sites Line: All sites (new ones included)
| Month | All sites (new ones included) | Same sites |
|---|---|---|
| October 2026 | 2% | 18% |
| November 2026 | 17% | 18% |
These lines have one month of figures so far. Each becomes a month-by-month line once a second month of figures arrives.
| Series | All sites |
|---|---|
| Sites scoring 71–80 | 19% |
| Sites scoring 61–70 | 2% |
Checks that have only one month of figures are not listed here again: their latest figure is in Every check.
Based on the sites Bot Appétit has scanned. Most of these sites come from lists we scan for research. Not a random sample of the web.
July 2026, August 2026, September 2026, October 2026, November 2026
Not enough history yet.
Based on the sites Bot Appétit has scanned. Most of these sites come from lists we scan for research. Not a random sample of the web.
Not enough performance data yet.
Core Web Vitals are Google's three measures of loading, responsiveness and visual stability. Field results come from real Chrome visitors over the past four weeks. Lab results come from one test run.
| Result | Share of sites |
|---|---|
| Lab test: good | 26% |
| Lab test: needs improvement | 56% |
| Lab test: poor | 19% |
Based on the sites Bot Appétit has scanned. Most of these sites come from lists we scan for research. Not a random sample of the web.
In November 2026, 21% of the sites we scanned cleared every one of the gates.
The gates are “Automated visitors can reach your pages”, “AI crawlers aren't blocked”, “Reached without a redirect chain”, “Your answer is in the HTML”, “Structured data is present”, “llms.txt is present and valid”: the basics a machine needs before it can use a page.
| Gates cleared | Share of sites |
|---|---|
| No gates cleared | 2% |
| One of six gates cleared | 1% |
| Two of six gates cleared | 1% |
| Three of six gates cleared | 4% |
| Four of six gates cleared | 39% |
| Five of six gates cleared | 31% |
| All six gates cleared | 21% |
Based on the sites Bot Appétit has scanned. Most of these sites come from lists we scan for research. Not a random sample of the web.
Figures generated 2026-11-02 from build f6cab0d030f13630. Download the data as JSON or CSV; both hold percentages only.
Milk Moon Studio, "Bot Appétit State of the Web & AI Readiness", botappetit.ai/state-of-the-web/, figures from November 2026.
Figures change every hour, so say which month you took them from.
A free scan checks all of this on your page in seconds, with no signup.
Want it handled? We do that too. No pitch, just a plain-English chat.
Book a call