Skip to content
DevMarDe
Crawler Tester · Squarespace

Crawler Tester for Squarespace sites

Test whether GPTBot, PerplexityBot, ClaudeBot and Google-Extended can actually fetch your pages. Most blocked sites do not know they are blocked. Portfolios, restaurants, studios and small services firms.

Free
10 second test
6
checks
Live
status

What Squarespace sites usually get wrong

  • Squarespace emits Organization and Article schema but exposes no sameAs field; custom code injection fills the gap.
  • robots.txt is not editable; Squarespace allows major crawlers and blocks some AI crawlers by policy.

Applying the result on Squarespace

  • How to change crawler rules on Squarespace. Not editable. Check Squarespace's current crawler policy before relying on AI visibility.

What Crawler Tester checks

  • GPTBotOpenAI crawler access.
  • PerplexityBotPerplexity crawler access.
  • ClaudeBotAnthropic crawler access.
  • Google-ExtendedGemini grounding access.
  • robots.txtDirectives that apply to each agent.
  • Edge rules403 and 429 responses that robots.txt does not explain.
100
Lighthouse performance on this site. Same for SEO, accessibility and best practices
5
products of our own in production
3
practices, each with a named lead
1 day
reply time on every enquiry
4.9
from 9 reviews

Questions people ask

Does Crawler Tester work with Squarespace?
Yes. It reads the public site, so the platform does not matter. The notes above cover where to apply the result on Squarespace.
Should I allow every crawler?
Not necessarily. This tells you what is happening so the choice is deliberate.
Does it slow my site?
No. It is a handful of requests.
Can I test staging?
Only if it is publicly reachable.