Skip to content
DevMarDe
Crawl Audit · WordPress

Crawl Audit for WordPress sites

See what AI assistants see when they visit your site, and the exact code to fix it. Crawl Audit crawls your site the way GPTBot does and scores the signals that decide how easily an assistant can read and understand your business. A free run scores 25 of them. The paid report scores 200, ranked by impact, each with the exact code to paste. No call, no scoping document. Most SMB marketing sites and a large share of clinic, school and professional-services sites.

Open Crawl Audit About Crawl Audit
crawlaudit.devmarde.com/r/8f2aCrawl Audit · Findings
FindingImpact
GPTBot blocked by firewall403 from bot protection on every pageHigh
llms.txt missingNothing tells an AI crawler what the site is forHigh
Entity records unlinkedNo sameAs on Organization schemaMedium
31 pages without dateModifiedModels discount content they cannot dateMedium
$7.89
one time
6
checks
Live
status

What WordPress sites usually get wrong

  • Security plugins such as Wordfence and hosts such as WP Engine often block unknown user agents by default; GPTBot returns 403 and nobody notices.
  • Yoast and Rank Math emit Organization schema but rarely include sameAs or a stable @id.
  • dateModified is emitted, but only updates when the post is saved, so bulk edits inflate freshness.

Applying the result on WordPress

  • llms.txt on WordPress. Upload llms.txt to the site root over SFTP, or serve it with a static-file plugin. Confirm it returns text/plain.
  • Schema on WordPress. Add the JSON-LD through the theme's header hook or a code-snippets plugin rather than a second SEO plugin, so there is one Organization block.
  • Crawlers on WordPress. Settings → Reading controls only the noindex flag. Edit robots.txt directly or through Yoast's file editor to allow GPTBot, PerplexityBot, ClaudeBot and Google-Extended.

What Crawl Audit checks

  • Crawler accessrobots.txt, firewall rules and rate limits for four AI crawlers.
  • Schema depthOrganization, Person, Product, FAQ and Article validity.
  • Entity recordsWikidata, Crunchbase and sameAs coverage.
  • Answer structureWhether pages answer a question in the first paragraph.
  • FreshnessdateModified, changelogs and stale-content flags.
  • Citations todayWhere four assistants already mention you.
100
Lighthouse performance on this site. Same for SEO, accessibility and best practices
5
products of our own in production
3
practices, each with a named lead
1 day
reply time on every enquiry
4.9
from 9 reviews

Questions people ask

Does Crawl Audit work with WordPress?
Yes. It reads the public site, so the platform does not matter. The notes above cover where to apply the result on WordPress.
Is this a manual audit?
No. It is a tool. You enter a domain and it runs. Nobody reviews it by hand.
Why $7.89 and not free?
A real crawl costs us money. The price covers it and keeps the queue clear.
Do I need the other tools?
No. Crawl Audit tells you what is wrong; the free generators help you fix it.
What does the free preview on this site show?
A server-side fetch of your homepage, robots.txt, sitemap and llms.txt, scored against 25 of the signals. The full crawl runs at crawlaudit.devmarde.com.