Free Bot View Checker
One of the free tools from KinetixSEO, an SEO and AI-citation (GEO) checker. Pick a crawler and see whether robots.txt lets it in, what your server sends a bot (status, redirects, the tags in the HTML), and how much of your page exists only after JavaScript runs.
What the Free Bot View Checker checks
- The HTTP status, redirect and content type your server sends a bot, fetched once under our own name (Kinetix-Auditor), never as the crawler
- Whether your CDN or firewall challenges a bot it does not recognise
- Whether robots.txt permits that crawler to request the URL at all, and which rule blocks it if not
- The title, meta description, canonical, robots meta tag and H1 a crawler can read in that HTML
- Word count and internal link count in that HTML
- For a crawler that does not execute JavaScript, how many words on the page exist only after rendering — content it will never see
Frequently asked questions
What does this tool actually do?
It fetches your page once under our own name, Kinetix-Auditor, and reads your robots.txt. Then it tells you three things for the crawler you picked: whether robots.txt lets it in, what your server sends a bot (the HTTP status, any redirect, a challenge from your CDN), and what that crawler can read in the HTML: title, meta description, canonical, robots meta tag and H1.
Why does it matter which crawler I pick?
Because they follow different robots.txt rules and behave differently. Googlebot and bingbot execute JavaScript before reading a page; OAI-SearchBot, PerplexityBot and Claude-SearchBot do not, so they only ever see the HTML your server sends. A page whose content is injected by JavaScript can rank in Google and be completely invisible to ChatGPT, Perplexity and Claude.
Do you pretend to be Googlebot?
No. We never send another crawler’s User-Agent. Every request says it is Kinetix-Auditor and links to kinetixseo.com/bot, which explains what we fetch and how to block us. The crawler you pick only decides whose robots.txt rules and JavaScript behaviour we apply.
Is this exactly what the real crawler receives?
It is what your server sends a bot it does not recognise. If your server, CDN or firewall treats a crawler differently by its name or IP address, this tool cannot see that, because seeing it would mean pretending to be that crawler. Your server logs show what the real crawler was served; upload them to our AI crawler log analysis to check.
Why does it take a few seconds?
It makes two requests, the page and robots.txt, and loads the page once in a real browser to measure how much content only exists after JavaScript runs. That last step is what lets it tell you what a crawler without JavaScript misses.
Related reading
Go deeper
This free check looks at one signal in isolation. KinetixSEO's paid report combines every signal below into one prioritised fix list and tracks it over time; the pricing page lists what each plan includes.
Full paid report: AI Crawler Checker →