Skip to content
SPECIFICTION
Get listed

crawler.sh

crawler.sh

From $8.25/mo Free plan WindowsmacOSLinux
Visit crawler.sh
Spec score 7.8 #124 of 245 in SEO tools

Spec sheet

Product
crawler.sh is a local web crawler that extracts website content, analyzes SEO issues, and exports results in standard formats.Read 12 Oct 2026 · crawler.sh
Free plan
YesRead 21 Sep 2026 · crawler.sh
Integrations
The documentation describes an MCP server for connecting crawler.sh output to tools and lists Claude Code, Claude Desktop, Cursor, OpenCode, and Zed as clients.Read 12 Oct 2026 · crawler.sh
Security
The privacy policy says device-to-API communication uses HTTPS/TLS and authentication tokens are generated with secure random values and expire after a set period.Read 12 Oct 2026 · crawler.sh
Support
Support is offered by email, with typical replies within one business day; the maker says it does not offer live chat, phone support, ticket SLAs, or dedicated account managers.Read 12 Oct 2026 · crawler.sh
AI content
It extracts article content as clean Markdown with page metadata such as word count, author byline, language, and excerpt for RAG, fine-tuning, or agent context.Read 12 Oct 2026 · crawler.sh
Cloud API
Crawler Cloud is described as a hosted crawling API with scheduled crawls, webhooks, and a dashboard, marked as coming soon.Read 12 Oct 2026 · crawler.sh
Crawl behavior
The crawler respects robots.txt and adapts per-host pacing after 429 and 403 responses.Read 12 Oct 2026 · crawler.sh
Data handling
The maker says crawl data, results, and exported files stay on the user's computer and that it does not collect crawl targets, results, or extracted website content.Read 12 Oct 2026 · crawler.sh
Interfaces
The product includes a CLI for automation and scripting and a desktop app with a visual dashboard; both use the same crawling engine.Read 12 Oct 2026 · crawler.sh
JavaScript rendering
A built-in JavaScript engine renders React, Vue, Next, and similar single-page apps without headless Chrome.Read 12 Oct 2026 · crawler.sh
SEO checks
The SEO analysis runs 24 automated checks on successful HTML pages and can export findings as CSV or TXT.Read 12 Oct 2026 · crawler.sh
Site audit
YesRead 21 Sep 2026 · crawler.sh
Windows support
A native Windows desktop build is in progress, and the maker says its Linux CLI binary can run on Windows through WSL2.Read 12 Oct 2026 · crawler.sh

Plans and prices

Free Free 50 pages per session Read 21 Sep 2026 · crawler.sh
CLI Pro $99 a year $99 / year 10,000 pages per session Read 21 Sep 2026 · crawler.sh
Desktop Pro $99 a year $99 / year Visual dashboard with interactive cards · Real-time crawl feed with status badges · SEO issues panel with per-URL details · Content archive export as Markdown Read 21 Sep 2026 · crawler.sh
Free Free Up to 50 pages per session · SEO analysis with CSV/TXT export · JSON and Sitemap XML export · No account required Read 12 Oct 2026 · crawler.sh
CLI Pro $99 a year $99 / year Up to 10,000 pages per session · NDJSON, JSON, and Sitemap XML output · Markdown content extraction · 16-category SEO analysis with CSV/TXT export Read 12 Oct 2026 · crawler.sh
Desktop Pro $99 a year $99 / year Visual dashboard with 8 interactive cards · Real-time crawl feed · SEO issues panel with per-URL details · Markdown content archive export Read 12 Oct 2026 · crawler.sh

Every crawler.sh plan and price →

Where Specifiction places it

Alternatives to crawler.shAll alternatives →