Research

Government & nonprofit AI readiness statistics

In November 2026, we could only place a site in an industry where our scanner could read the page, so this page covers Government & nonprofit sites we could read and says nothing about how many turned our scanner away.

Updated 13:07 UTC · November 2026

Based on the sites Bot Appétit has scanned. Most of these sites come from lists we scan for research. Not a random sample of the web.

All sites on the State of the Web

See the Government & nonprofit leaderboard

How Government & nonprofit sites land

Every page we read gets a score out of 100, the number at the top of its report (how scoring works). Each row is a range of scores. Where too few sites score in the lowest ranges, they are joined into one row.

  • 81–90 39%
  • 0–80 33%
Show as a table
Share of Government & nonprofit sites in each score range
ScoreShare of sites
81–9039%
0–8033%

An industry is only known for a page our scanner could read, so these shares are of the Government & nonprofit sites we could read.

Based on the sites Bot Appétit has scanned. Most of these sites come from lists we scan for research. Not a random sample of the web.

Better or worse

Not enough history yet.

Based on the sites Bot Appétit has scanned. Most of these sites come from lists we scan for research. Not a random sample of the web.

AI access

  • robots.txt disallows some AI crawlers 3%
  • robots.txt disallows major AI crawlers 0%
Show as a table
How Government & nonprofit sites treat AI crawlers
What we foundShare of sites
robots.txt disallows some AI crawlers3%
robots.txt disallows major AI crawlers0%

Based on the sites Bot Appétit has scanned. Most of these sites come from lists we scan for research. Not a random sample of the web.

What Government & nonprofit sites get right and wrong

Passed more often than on the average site: “Reading the page is affordable for a machine” (99%, against 92% of all sites); “Claims come with figures, quotes or sources” (62%, against 56% of all sites); “A machine-readable published / updated date” (16%, against 11% of all sites). Least often passed: several checks that no Government & nonprofit site we could read passed.

Every check, Government & nonprofit against all sites

Share of sites that pass each check, over the sites the check applies to. The Gap column is the difference in percentage points between the two shares; a dash means not enough sites yet.

Government & nonprofit sites against all sites: share passing each check
Check Government & nonprofit sites All sites Gap (points)
Served over a secure HTTPS connection 100% >99% Level
HTTP redirects to HTTPS 98% 95% +3 points
No mixed (insecure) content 100% 99% +1 point
Core security headers are set 14% 9% +5 points
Not flagged for malware or phishing 100% 100% Level
No server version leakage 91% 94% −3 points
security.txt is published 4% 5% −1 point
Reached without a redirect chain 100% 99% +1 point
Caching or validation headers are set 97% 95% +2 points
The site settles on one host (www vs non-www) 87% 87% Level
robots.txt is present and not over-blocking 91% 91% Level
Not accidentally set to noindex 99% 99% Level
This page declares its canonical URL 47% 59% −12 points
Mobile viewport is set 98% 94% +4 points
Has a title tag 100% >99% Level
Title fits a search snippet 48% 59% −11 points
Has a meta description 89% 91% −2 points
Description fits a search snippet 49% 64% −15 points
The page has an H1 82% 87% −5 points
Logical heading order 59% 64% −5 points
Topic is consistent across title, H1 and description 53% 65% −12 points
Images have descriptive alt text 91% 96% −5 points
Your page's HTML isn't oversized 100% 99% +1 point
Open Graph tags for sharing 22% 23% −1 point
Twitter/X card tags 75% 75% Level
XML sitemap is present and referenced 65% 76% −11 points
Missing pages return a real 404 95% 93% +2 points
Images are optimised 8% 13% −5 points
Language and charset declared 83% 85% −2 points
hreflang for language variants — 99% —
Analytics is installed 77% 76% +1 point
Search Console / Bing verification 71% 82% −11 points
A favicon is set 99% 99% Level
No meta-refresh redirect 100% >99% Level
Your content survives without JavaScript 96% 97% −1 point
Your answer is in the HTML 96% 96% Level
Buttons, links and fields have names 27% 32% −5 points
Semantic HTML landmarks 47% 50% −3 points
Content is scannable in self-contained chunks 93% 94% −1 point
Claims come with figures, quotes or sources 62% 56% +6 points
Section headings are phrased as questions 14% 22% −8 points
Reading the page is affordable for a machine 99% 92% +7 points
No hidden text written for an AI model 100% >99% Level
Sitemap dates tell a machine what changed 67% 68% −1 point
The links in llms.txt resolve — 84% —
Author / publisher is clear 39% 51% −12 points
A machine-readable published / updated date 16% 11% +5 points
llms.txt is present and valid 10% 29% −19 points
Clean content for agents (Markdown) 3% 4% −1 point
Structured data is present 38% 56% −18 points
Structured data is valid 97% 97% Level
FAQ / Q&A schema — 47% —
Organization schema with sameAs 22% 33% −11 points
Right schema type for the page 97% 95% +2 points
Schema facts also appear in the page text — 57% —
Breadcrumb structured data — 28% —
AI crawlers aren't blocked 95% 92% +3 points
Automated visitors can reach your pages — — —
Engines are allowed to quote the page 100% 99% +1 point
Your page arrives quickly 97% 97% Level
AI bot rules are explicit and intentional 3% 14% −11 points
Content usage preferences declared 2% 4% −2 points
Resource-discovery Link headers 0% 2% −2 points
No broken links 87% 87% Level
Links don't point at redirects 90% 92% −2 points
Descriptive anchor text 98% 99% −1 point
Sensible internal/external link mix 99% 96% +3 points
Links are real links 89% 92% −3 points
Largest Contentful Paint (LCP) — — —
Cumulative Layout Shift (CLS) — — —
Interaction to Next Paint (INP) — — —
Page weight and render-blocking — — —
MCP Server Card 0% 1% −1 point
AI catalog 0% 1% −1 point
A2A Agent Card 0% <1% Level
WebMCP tools in the page 0% <1% Level
AI usage preferences (Content-Usage) 0% <1% Level
Licensing terms for AI (RSL) 0% <1% Level
Text-and-data-mining reservation (TDMRep) 0% <1% Level
Markdown version linked from the page 0% 1% −1 point
Content signals agree everywhere — — —
Agent Skills index 0% 1% −1 point
API catalog 0% 1% −1 point
OAuth authorization-server metadata 1% 2% −1 point
OAuth protected-resource metadata 1% 2% −1 point
OpenID Connect discovery 1% 2% −1 point
Web Bot Auth (operates a signed bot) 0% <1% Level
Universal Commerce Protocol manifest — 7% —
Auth.md agent registration 0% <1% Level
AI discovery via DNS 0% <1% Level

Based on the sites Bot Appétit has scanned. Most of these sites come from lists we scan for research. Not a random sample of the web.

See how your site compares

A free scan checks all of this on your page in seconds, with no signup.

Scan your site free

Want it handled? We do that too. No pitch, just a plain-English chat.

Book a call