Short answer: for a small business that wants to know whether ChatGPT, Perplexity and Claude can read its website, and what to fix first, Crawl Audit by DevMarDe is the one we built for exactly that, and the table puts it first. It works on any website, the free run needs no sign-up, and the full 200-signal report costs $7.89 once, which is the lowest price of the paid options below. Other tools are better for other jobs: crawlaudit.tech is made for Shopify stores, and CrawlerCheck is a quick robots.txt and header check. Every line below comes from each tool's own website, read on 26 October 2026, and where a site does not say something we write "not stated" instead of guessing.
Side by side
Swipe the table sideways to compare. The row labels stay in view.
| Crawl Audit by DevMarDe | crawlaudit.tech | Parsigo | CrawlerCheck | CrawlCheck | |
|---|---|---|---|---|---|
| Built for | Any website | Shopify stores | Any website | Any website | Any website |
| What it checks | 200 signals: crawler access, structured data, entity records, answer structure, freshness | Six areas, including product data and AI readiness | Access, readability without JavaScript, structure | robots.txt, meta robots, X-Robots-Tag | robots.txt against 60+ AI crawlers, llms.txt, sitemap |
| Crawlers tested | GPTBot, PerplexityBot, ClaudeBot | 9 AI crawlers | 34 crawlers | Search, AI, SEO-tool, social and scraper bots | 8 AI crawlers live, 60+ by robots.txt |
| Free option | Yes, 25 signals | Yes | Yes, quick check | Yes | Yes, one URL |
| Paid report | $7.89 once, 200 signals | $29 once (AI Shop Audit) | Extended version, price not stated | Not stated | $49 once, up to 50 pages |
| Sign-up for the free check | Not needed | Not needed | Not needed | Not stated | Not needed |
| Score | Shown check by check | 0 to 100 | Weighted: access 45%, readability 35%, structure 20% | Not stated | Not stated |
| Who makes it | DevMarDe (Designn Space Ltd, UK company 14258316) | Not stated | Not stated | Credits bogozi.com | Not named |
Two of these have almost the same name. crawlaudit.tech and Crawl Audit by DevMarDe are separate products from separate companies. Ours lives at crawlaudit.devmarde.com and devmarde.com/tools/crawl-audit, and we have used the name since 8 October 2026. The domain crawlaudit.tech was registered on 19 October 2026, according to the registry record.
How to choose
- Start with the question. "Is my robots.txt blocking an AI bot?" needs a rules checker such as CrawlerCheck or the free scan from CrawlCheck. "Can the bot read my text without JavaScript?" needs a tool that compares raw and rendered content, which Parsigo says it does. "What should I fix first, and what is the code?" needs a report with fixes, which is what paid reports sell.
- Check which crawlers are tested. The crawler that decides whether ChatGPT search can use your pages is OAI-SearchBot, not GPTBot. See which AI crawler user agents exist and what to allow.
- Check rules against reality. A robots.txt rule can allow a bot while a firewall still blocks it. If you use Cloudflare, read how to tell whether it is blocking ChatGPT, and see the four quick tests you can run yourself.
- Read what the score is made of. A score out of 100 is only useful if you can see which checks drive it. Parsigo publishes its weights. Ours are explained check by check in the check explainers.
What our free run does not do
The free run scores 25 of the 200 signals, so it will miss problems that only show up in the other 175. It tests access and reading, not whether an assistant actually mentions you. None of the five tools tells you whether ChatGPT or Perplexity names your business. For that, ask the assistants the same questions on fixed dates and keep the answers, which is how we run our own measurement log.
Questions people ask
What is the best free AI crawl audit tool?
It depends on what you need checked. For crawler rules on one page, CrawlerCheck and CrawlCheck's free scan are free. For a Shopify store, crawlaudit.tech is free. For any site with a scored report, Parsigo's quick analysis and our free 25-signal run are free. None of them is best for every case.
Is crawlaudit.tech the same as Crawl Audit by DevMarDe?
No. They are different products from different companies with similar names. crawlaudit.tech is for Shopify stores. Crawl Audit by DevMarDe is at crawlaudit.devmarde.com and works on any website. Check the address before you enter your site.
How much do AI crawl audit tools cost?
Prices on the sites we read: crawlaudit.tech's paid AI Shop Audit is $29 one time, CrawlCheck's Pro Deep Report is $49 one time, and our Crawl Audit full report is $7.89 one time. CrawlerCheck and Parsigo do not state a price for anything beyond the free check.
Do these tools show whether ChatGPT mentions my business?
No, they test whether crawlers can reach and read your site. Whether an assistant names you is a separate test. See how to measure AI search optimization.
Is the free check enough?
For a first look, yes. It tells you whether the obvious doors are open. Fix what it finds, then decide whether a deeper report is worth paying for.
Sources
- crawlaudit.tech, read 26 October 2026
- Parsigo, read 26 October 2026
- CrawlerCheck, read 26 October 2026
- CrawlCheck, read 26 October 2026
- Crawl Audit by DevMarDe, our own tool
- Domain registration date of crawlaudit.tech: .tech registry RDAP record (rdap.radix.host), read 26 October 2026
Related
View all →Crawl audit checklist, including the AI crawlers
What a crawl audit checks, the checklist, our own numbers, and the AI-crawler half most audits skip. Plus Crawl Audit by DevMarDe, the tool that runs it.
AI optimization, AI search optimization, GEO and AEO: what the names mean and what to do first
Four names for mostly the same job. What each term usually means, what Google says about optimizing for AI features, the one academic definition, and the order to work in.
AI crawler user agents: what to allow, from GPTBot to ClaudeBot
Every AI crawler name you will see in your logs, what each one is for, which to allow if you want to be found in AI answers, copy-paste robots.txt rules, and the test we ran on our own site.
Find out whether AI answers can read your site.
Crawl Audit scores your own domain against the signals in this guide. The free check needs no sign-up; the full report is $7.89, one time.