Research

The most common AI search issues on 129 websites (November 2026)

83% of the 129 sites we scanned do not open the homepage with a direct answer, and 64% have weak meta descriptions. The full list, from our scan data.

By the Why Won't AI teamPublished 2 min readAsk about this page:ChatGPTClaude
On this page

We counted how many of 129 scanned websites had each issue. The most common issues are not technical failures. They are copy and linking gaps: a homepage that does not say plainly what the product does, and pages that get links only from menus. Half of the sites also cannot see visits that come from AI assistants.

The 12 most common issues

IssueSitesShare of sites
The homepage does not open with a direct, specific answer10783%
Pages with a missing or badly sized meta description8264%
The site does not return Markdown to AI agents that ask for it8264%
Pages that get links only from menus and footers8163%
No rule that separates visits from AI assistants in analytics6450%
No analytics tag found in the homepage HTML or main scripts6349%
Pages with a missing or badly sized title6147%
Pages with no internal links pointing to them5744%
Pages that wait for another host before the first paint5140%
No llms.txt file4636%
Every crawler sees little or no text on most pages3729%
Navigation links exist only after JavaScript runs3326%

Other issues we counted

  • Most pages have no structured data: 28 sites (22%).
  • Unknown URLs return a normal page instead of a 404: 28 sites (22%).
  • Real Chrome users see a slow Largest Contentful Paint: 24 sites (19%).
  • No sitemap found: 14 sites (11%).
  • robots.txt blocks AI crawlers: 3 sites (2%).

What this means

An AI assistant quotes pages that say clearly what a product does and for whom. A homepage that opens with a slogan gives it less to quote. Pages that only a menu links to look less important to crawlers. And without analytics, a team cannot see whether AI assistants send any visits at all.

How we got these numbers

We took the latest scan of each site that was scanned with Why Won't AI from November 11 to November 17, 2026: 129 sites. We left out our own three sites. Many of the sites are new products whose founders listed them on launch directories, so the sample leans to small, new sites. It is not a random sample of the web. We do not name any site.

What is the most common AI search issue?

In our data, 83% of 129 sites did not open the homepage with a direct, specific answer to what the product is and who it is for.

How many sites have an llms.txt file?

64% of the sites in this data had one. 46 of 129 sites (36%) did not.

Can I see which of these issues my site has?

Yes. The free scan lists the issues on your own site, most severe first.