Every Crawl Audit check, explained
Crawl Audit scores a site on 200 checks in six modules. Each explainer says what the check looks at, why it matters and how to fix it on common platforms. We publish them in batches: 200 of 200 are live, and the rest are listed so you can see everything the report covers.
AI Search Visibility & GEO
Checks 1–30 · 30 explained- 1GPTBot permission status in robots.txt
- 2ClaudeBot permission status in robots.txt
- 3PerplexityBot permission status in robots.txt
- 4Google-Extended permission status in robots.txt
- 5Bytespider permission status in robots.txt
- 6CCBot (Common Crawl) permission status in robots.txt
- 7Organization JSON-LD schema presence
- 8WebSite JSON-LD schema with SearchAction presence
- 9Product schema validation (pricing, availability, SKU)
- 10FAQPage schema validation
- 11Article / BlogPosting schema validation
- 12BreadcrumbList schema validation
- 13LocalBusiness schema & geolocation validation
- 14Review / AggregateRating schema validation
- 15HowTo schema validation
- 16High-density semantic entity extraction score
- 17Direct-answer summary blocks above the fold
- 18Question-based header formatting (H2/H3 query matching)
- 19Machine-readable HTML tables for structured data
- 20Semantic tag structure (<article>, <section>, <aside>)
- 21Machine-readable pricing & package structures
- 22Bulleted key-benefit list density ratio
- 23Contextual definition blocks for industry entities
- 24Author profile schema & sameAs linking
- 25NAP (Name, Address, Phone) data consistency
- 26sameAs social profile schema array presence
- 27External authority Wikipedia/Wikidata entity links
- 28Verification of official accreditation/award markup
- 29Machine-readable copyright & licensing tags
- 30Outbound cited reference link presence
Technical SEO & Indexability
Checks 31–70 · 40 explained- 31robots.txt file presence and syntax validation
- 32XML Sitemap presence and accessibility
- 33XML Sitemap file size check (<50MB uncompressed)
- 34XML Sitemap reference in robots.txt
- 35HTML Sitemap page availability
- 36Self-referential canonical tag check
- 37Missing canonical tag detection
- 38Duplicate canonical URL declaration check
- 39Meta noindex tag detection
- 40Meta nofollow tag detection
- 41URL character length audit (<100 characters)
- 42Clean URL slug validation (hyphens vs. underscores/special characters)
- 43Trailing slash consistency check (/ vs. non-slash)
- 44Uppercase vs. lowercase URL path check
- 45Deep folder nesting hierarchy audit (>4 subfolders deep)
- 46Orphan page detection (pages without internal incoming links)
- 47Internal link count per page audit (<150 total links)
- 48HTTP-to-HTTPS 301 permanent redirect validation
- 49Multi-hop redirect chain detection (301 > 301 > 200)
- 50Temporary 302 redirect misconfiguration check
- 51Title tag presence validation
- 52Title tag character length (50-60 characters)
- 53Meta description presence validation
- 54Meta description character length (120-160 characters)
- 55Duplicate title tag audit across site
- 56Duplicate meta description audit across site
- 57Single <h1> tag presence per page
- 58Missing <h1> tag detection
- 59Sequential heading hierarchy check (H1 > H2 > H3 without skipping)
- 60Empty or whitespace-only heading tag audit
- 61Broken internal link audit (404 Error detection)
- 62Broken external link audit (Dead outgoing links)
- 63Internal rel="nofollow" attribute audit
- 64Paid/affiliate link rel="sponsored" tag audit
- 65User-generated content rel="ugc" link tag audit
- 66External link target="_blank" missing rel="noopener noreferrer"
- 67Pagination rel="next" / rel="prev" implementation
- 68Paginated page canonical handling (self-referencing vs. page 1)
- 69URL parameter handling & dynamic tracking clean-up
- 70hreflang language tag validation & bidirectional link check
Performance & Core Web Vitals
Checks 71–100 · 30 explained- 71Time to First Byte (TTFB < 0.8s)
- 72Largest Contentful Paint (LCP < 2.5s)
- 73Interaction to Next Paint (INP < 200ms)
- 74Cumulative Layout Shift (CLS < 0.1)
- 75First Contentful Paint (FCP < 1.8s)
- 76Total Blocking Time (TBT < 200ms)
- 77Speed Index evaluation (<3.4s)
- 78DOM tree size audit (<1,500 total nodes)
- 79Next-gen image format check (WebP/AVIF vs. PNG/JPG)
- 80Image compression status (uncompressed asset flag)
- 81Image explicit width and height attribute check
- 82CSS minification check
- 83JavaScript minification check
- 84Unused CSS coverage audit (>20KB unused)
- 85Unused JavaScript execution audit (>50KB unused)
- 86Render-blocking CSS stylesheet identification
- 87Render-blocking JavaScript file identification
- 88Critical above-the-fold CSS inline implementation
- 89Gzip compression header check
- 90Brotli compression header check
- 91HTTP Cache-Control header duration check (>30 days for static assets)
- 92Content Delivery Network (CDN) edge detection
- 93DNS lookup latency check (<100ms)
- 94HTTP/2 or HTTP/3 protocol support
- 95HTTP Keep-Alive header configuration
- 96Server HTTP response status code audit (200 OK baseline)
- 97Custom web font preloading check (rel="preload")
- 98Font rendering swap optimization (font-display: swap)
- 99Third-party script execution deferral (defer / async)
- 100Native lazy loading on below-the-fold images (loading="lazy")
UX & Conversion (CRO)
Checks 101–140 · 40 explained- 101Viewport meta tag declaration check
- 102Disabled user zooming/scaling audit (user-scalable=no flags)
- 103Mobile horizontal scroll / content overflow detection
- 104Minimum touch target size audit (minimum 48x48px)
- 105Mobile font size legibility audit (minimum 16px body text)
- 106Responsive image implementation (srcset / <picture>)
- 107Sticky mobile header screen footprint (<15% viewport)
- 108Mobile navigation hamburger menu accessibility
- 109Intrusive interstitial / pop-up overlay detection
- 110Tap-to-call phone link validation (tel: protocol)
- 111Primary Call-To-Action (CTA) button visibility above the fold
- 112Primary CTA background contrast ratio against hero background
- 113Secondary CTA distinct visual hierarchy
- 114Unique Value Proposition (UVP) headline clarity score
- 115Hero element rendering delay check
- 116Pricing table / product offer accessibility above the fold
- 117High-resolution product / service hero image present
- 118Form input field count check (maximum 3-5 fields recommended)
- 119Browser auto-fill attribute support on forms (autocomplete="")
- 120Clear inline form error notification styling
- 121Customer review / star rating badge placement above the fold
- 122Client / partner logo trust bar visibility
- 123SSL security trust badge / seal visibility near conversion points
- 124Money-back guarantee / risk-reversal microcopy near CTAs
- 125Founder / team bio or company verification page present
- 126Direct contact phone number in header or footer
- 127Physical business address listed in page footer
- 128Direct link to Privacy Policy in footer
- 129Direct link to Terms of Service in footer
- 130Functional live chat or support widget presence
- 131On-site search bar presence for complex site catalogs
- 132Search input accessibility and placeholder text
- 133Custom branded 404 page fallback with navigation links
- 134Floating "Back to Top" navigation button on long scroll pages
- 135Sticky mobile conversion bar on scroll
- 136Accessible cookie consent banner configuration
- 137Breadcrumb visual navigation trail present
- 138Interactive hover/focus state on all clickable links
- 139Modal overlay close button (X) clarity and tap size
- 140Post-form submission confirmation / thank-you page trigger
Security & Infrastructure
Checks 141–170 · 30 explained- 141Active SSL/TLS certificate validity check
- 142SSL certificate expiration lead time (>30 days remaining)
- 143TLS protocol version enforcement (TLS 1.2 or 1.3 required)
- 144Mixed content warning check (HTTP assets on HTTPS page)
- 145Automatic HTTP-to-HTTPS redirection enforcement
- 146Strict-Transport-Security (HSTS) header implementation
- 147X-Frame-Options header presence (Clickjacking defense)
- 148X-Content-Type-Options: nosniff header presence
- 149Content-Security-Policy (CSP) header configuration
- 150Referrer-Policy header configuration
- 151Permissions-Policy (Feature Policy) header presence
- 152X-XSS-Protection legacy header verification
- 153Server software version masking (Hiding Server: Nginx/Apache detail)
- 154Framework software version masking (Hiding X-Powered-By: Express/PHP)
- 155Cross-Origin Resource Sharing (CORS) access control policy
- 156Subresource Integrity (SRI) hash on external CDN scripts
- 157SPF (Sender Policy Framework) record DNS validation
- 158DKIM (DomainKeys Identified Mail) DNS record presence
- 159DMARC (Domain-based Message Authentication) DNS enforcement policy
- 160MX DNS record validity and security status
- 161Exposed server port scan (Restricted to ports 80 and 443)
- 162Directory listing vulnerability check (Options -Indexes)
- 163Open URL redirection parameter audit
- 164Input field reflection XSS vulnerability check
- 165Canonical domain forwarding check (www vs. non-www resolving to single domain)
- 166Default admin login panel path concealment (/wp-admin / /admin checks)
- 167Publicly accessible source backup files (.bak, .zip, .tar)
- 168Publicly exposed .git directory check
- 169Publicly exposed environment file check (.env)
- 170Default server installation landing page suppression
Content Quality & Accessibility
Checks 171–200 · 30 explained- 171Image missing alt attribute audit across all media
- 172Decorative image alt="" null attribute check
- 173WCAG AA body text color contrast ratio check (Minimum 4.5:1)
- 174WCAG AA large text color contrast ratio check (Minimum 3:1)
- 175Screen reader ARIA labels on icon-only buttons (aria-label)
- 176Dynamic UI state aria-expanded tag declaration
- 177Visible keyboard navigation focus outline (:focus-visible)
- 178Skip-to-main-content accessible link presence
- 179Form input <label> explicit association (for="input_id")
- 180Media auto-play restriction with audio output
- 181Semantic <main> landmark element presence
- 182Semantic <nav> landmark element presence
- 183Semantic <header> landmark element presence
- 184Semantic <footer> landmark element presence
- 185Logical tabindex DOM navigation order check
- 186Page word count threshold check (>300 words for indexable pages)
- 187Thin content penalty risk flag (<150 words)
- 188Flesch-Kincaid Reading Ease score calculation
- 189Keyword density / stuffing anomaly flag (>3.5% density)
- 190Duplicate body copy block detection across internal pages
- 191External source citation / link validity audit
- 192Automated spell check anomaly flag
- 193Content last modified date timestamp presence
- 194Social sharing action button availability
- 195OpenGraph title tag presence (og:title)
- 196OpenGraph description tag presence (og:description)
- 197OpenGraph share image dimension audit (1200x630px recommended)
- 198Twitter Card metadata tag presence (twitter:card set to summary_large_image)
- 199Standard Favicon file format and sizing (32x32px PNG/ICO)
- 200Apple Touch Icon presence for mobile bookmarking (180x180px)