KinetixSEO crawl study
AI search crawler blocking among public B2B SaaS homepages
0% of the 45 public B2B SaaS homepages still block at least one AI search crawler in robots.txt.
Measured · n = 45 · cohort: public B2B SaaS homepages
The numbers
0 of 45 (0.0%)
- Block at least one AI search crawler
- 0
- Allow all three AI search crawlers
- 45
- Sites observed (sample size)
- 45
- Listed but unreachable on the day (excluded)
- 0 of 45
The headline rounds to a whole percent (0%); the exact share is 0.0% of the observed sample.
Methodology
How this was measured
Fetched robots.txt for each of the 45 public B2B SaaS homepages and counted the sites carrying a Disallow rule that blocks OAI-SearchBot, PerplexityBot, or Claude-SearchBot from the site root.
One observation: Whether the site's robots.txt blocks OAI-SearchBot, PerplexityBot or Claude-SearchBot from the site root.
How the cohort was chosen: Hand-curated 2026-09-04 from widely cited public "most used B2B SaaS products" listings. Every URL is the vendor's own public homepage; no customer data and no private endpoint is involved.
Every request was a single polite fetch per site with a short timeout and no retries. Only aggregate counts are published — no per-site result.
Limitations
What this figure does not tell you
- The cohort is a named, hand-curated list, not a random sample of the web. The share describes these sites, not every site.
- It is one measurement on the date shown. Any site can change its setup the next day.
- Only robots.txt was read. A site can also block AI crawlers at its CDN or firewall, which this check cannot see, and only the three citation-feeding crawlers were tested, against the site root.
How to cite
Use this data
KinetixSEO (2026). AI search crawler blocking among public B2B SaaS homepages [Data set]. KinetixSEO crawl study, measured 25 September 2026, n = 45. https://kinetixseo.com/learn/studies/saas-homepages-ai-crawler-block
Published under a CC BY 4.0 license: free to reuse with attribution. Download the aggregate results as CSV (every published run of this study).
Every published run
Run history
| Measured | Block at least one AI search crawler | Share | Sample size | Unreachable |
|---|---|---|---|---|
| 0 | 0.0% | n = 45 | 0 of 45 |
Where does your own site land?
Run the same kinds of checks on your own page with a free SEO and GEO audit. No signup.