Skip to content
SPECIFICTION
Get listed

SiteOne Crawler

crawler.siteone.io

Free plan WindowsmacOSLinuxAPISelf-hosted
Visit crawler.siteone.io
Spec score 8.0 #93 of 245 in SEO tools

What it is

SiteOne Crawler is a free website crawler and audit tool that examines SEO, performance, accessibility, security, best practices, and content. It produces an interactive HTML report or text and JSON output, and assigns a quality score from 0.0 to 10.0 across five areas: performance, SEO, security, accessibility, and best practices. It can save a static copy of a website for offline browsing, turn a whole site into Markdown, and generate llms.txt. An optional Chromium mode renders JavaScript-driven pages before crawling. The native Rust binary runs on Windows, macOS, and Linux, with desktop and command-line variants; it has no runtime dependencies. API access and self-hosting are also listed. A CI/CD quality gate offers configurable thresholds, JUnit XML, GitHub annotations, and exit code 10 when checks fail. Reports can be shared through a free service using secure URLs with optional expiration and password protection. The default crawl uses three workers and no more than 10 requests per second combined. Plans are listed at free.

Spec sheet

Purpose
SiteOne Crawler crawls websites and analyzes SEO, performance, accessibility, security, best practices, and content, then produces an interactive HTML report or text and JSON output.Read 7 Oct 2026 · crawler.siteone.io
Audience
The maker identifies website owners, developers, QA engineers, administrators, DevOps practitioners, and consultants as intended users.Read 7 Oct 2026 · crawler.siteone.io
Free plan
YesRead 21 Sep 2026 · crawler.siteone.io
Support
The maker lists GitHub Issues for bugs and feature requests and GitHub Discussions for questions and discussion.Read 7 Oct 2026 · crawler.siteone.io
AI integrations
Its opt-in AI assistant supports OpenAI, Anthropic, Google Gemini, vLLM, Ollama, LM Studio, and OpenAI-compatible endpoints.Read 7 Oct 2026 · crawler.siteone.io
API access
YesRead 21 Sep 2026 · crawler.siteone.io
CI/CD
The built-in CI/CD quality gate supports configurable thresholds, JUnit XML, GitHub annotations, and exit code 10 on failure.Read 7 Oct 2026 · crawler.siteone.io
Default crawl rate
By default, it uses three workers and no more than 10 requests per second combined.Read 7 Oct 2026 · crawler.siteone.io
JavaScript sites
Optional browser mode uses Chromium to render pages so JavaScript-driven sites can be crawled with their post-render DOM.Read 7 Oct 2026 · crawler.siteone.io
Markdown export
It can convert an entire website to Markdown and generate llms.txt.Read 7 Oct 2026 · crawler.siteone.io
Offline copy
It can export a static copy of a website for offline browsing.Read 7 Oct 2026 · crawler.siteone.io
Quality scoring
It assigns a 0.0–10.0 quality score across performance, SEO, security, accessibility, and best practices.Read 7 Oct 2026 · crawler.siteone.io
Report sharing
A free report-sharing service can provide a secure URL with optional expiration and password protection.Read 7 Oct 2026 · crawler.siteone.io
Runtime dependencies
The Rust binary has zero runtime dependencies, with no Node, Python, or Docker required.Read 7 Oct 2026 · crawler.siteone.io
Site audit
YesRead 21 Sep 2026 · crawler.siteone.io
Supported systems
The single native binary runs on Windows, macOS, and Linux, with desktop and command-line variants.Read 7 Oct 2026 · crawler.siteone.io

Plans and prices

Free Free Open-source website crawling and analysis · CLI and desktop application · HTML, text, and JSON reports Read 21 Sep 2026 · crawler.siteone.io
SiteOne Crawler Free Free, open-source alternative; no account required Read 7 Oct 2026 · crawler.siteone.io

Every SiteOne Crawler plan and price →

Strong points and limits

Strong points

  • Free plan; no account required.
  • Outputs interactive HTML, text, and JSON reports.
  • Exports offline copies and Markdown; generates llms.txt.
  • CI/CD gate supports thresholds, JUnit XML, and GitHub annotations.
  • Native binary needs no runtime dependencies.

Limits

  • Default rate is at most 10 requests per second combined.
  • JavaScript rendering requires optional Chromium browser mode.

Who it suits

It suits website owners, developers, QA engineers, administrators, DevOps practitioners, and consultants who need to inspect sites or use crawl results in CI/CD. Its desktop and command-line variants, API access, and self-hosting option support different workflows.

Verdict

SiteOne Crawler combines site auditing with offline-copy and Markdown exports, multiple report formats, and a CI/CD quality gate. Its listed plans are free, and its native binary runs without Node, Python, or Docker.

Where Specifiction places it

Alternatives to SiteOne CrawlerAll alternatives →