Open SEO Crawler
github.com
What it is
Open SEO Crawler is a free, self-hosted, open-source tool for auditing websites for technical SEO issues. It checks titles, meta descriptions, H1s, canonicals, structured data, redirects, HTTP errors, indexability, hreflang, mobile viewports, mixed content, images and security headers. It detects numerous CMS platforms, including Shopify, WordPress, Webflow, Wix, Squarespace, Kajabi, Ghost, Drupal, HubSpot and Joomla, then applies crawl recommendations. Optional Playwright rendering supports JavaScript-heavy sites, while compare mode identifies content absent from raw HTML.
Bulk reports can be exported to XLSX, and sitemap export is available. Default settings allow 1,500 pages, five workers, a 0.4-second per-host delay and depth 10; the page cap can be changed to unlimited. The crawler runs locally without accounts, telemetry or API calls, though it contacts target sites and checks GitHub for updates when requested. Installers are documented for Linux, macOS 11 or newer, and Windows 10/11. The project uses the MIT license.
Spec sheet
- Purpose
- A self-hosted, open-source SEO crawler that audits websites for technical SEO issues.Read 7 Oct 2026 · github.com
- Intended users
- The README describes it as built for SEO professionals, web developers, and site owners, with use cases including technical audits, migration checks, and competitor research.Read 7 Oct 2026 · github.com
- Free plan
- YesRead 21 Sep 2026 · github.com
- Privacy
- The crawler runs locally with no accounts, telemetry, or API calls; it contacts the target site and checks GitHub for updates when requested.Read 7 Oct 2026 · github.com
- Support
- The maintainer directs bug reports to GitHub Issues and other inquiries to LinkedIn.Read 7 Oct 2026 · github.com
- License
- The project is released under the MIT license.Read 7 Oct 2026 · github.com
- CMS support
- Detects Shopify, WordPress, Webflow, Wix, Squarespace, Kajabi, Ghost, Drupal, HubSpot, and Joomla, and applies crawl recommendations.Read 7 Oct 2026 · github.com
- Competitor research
- YesRead 21 Sep 2026 · github.com
- Crawl checks
- Checks page titles, meta descriptions, H1s, canonicals, structured data, redirects, HTTP errors, indexability, hreflang, mobile viewport, mixed content, images, and security headers.Read 7 Oct 2026 · github.com
- Crawl configuration
- The default crawl settings are 1,500 pages, five workers, a 0.4-second per-host delay, and depth 10; the page cap can be set to unlimited.Read 7 Oct 2026 · github.com
- Exports
- Bulk reports can be exported to XLSX, and the tool also provides sitemap export.Read 7 Oct 2026 · github.com
- Installation
- Installers are documented for Linux Mint/Ubuntu/Debian, macOS 11 or newer on Intel and Apple Silicon, and Windows 10/11.Read 7 Oct 2026 · github.com
- JavaScript rendering
- Optional Playwright rendering supports JavaScript-heavy sites, with a compare mode that identifies content missing from raw HTML.Read 7 Oct 2026 · github.com
- Performance
- The README reports that a 1,500-page WordPress site crawled in under three minutes using five workers and default delay settings.Read 7 Oct 2026 · github.com
- Site audit
- YesRead 21 Sep 2026 · github.com
Plans and prices
Strong points and limits
Strong points
- Checks a wide range of technical SEO issues.
- Supports CMS-specific crawl recommendations.
- Optional rendering covers JavaScript-heavy sites.
- Exports XLSX reports and sitemaps.
- Free, MIT-licensed and self-hosted.
Limits
- Default crawl limit is 1,500 pages.
- JavaScript rendering is optional.
- Contacts target sites during crawls.
- Update checks contact GitHub when requested.
Who it suits
The crawler suits SEO professionals, web developers and site owners conducting technical audits, migration checks or competitor research. Its local operation and configurable page cap may fit users who want to run crawls without accounts or API keys.
Verdict
Open SEO Crawler provides extensive checks, configurable crawling and local operation without account or API requirements. Its default page cap is limited, but can be set to unlimited.
Where Specifiction places it
- SEO tools#119 of 2457.8
- SEO Audit Software#18 of 358.0
- SEO Crawler Software#19 of 347.9