Crawlr vs LibreCrawl
Crawlr
crawlr.aiLibreCrawl
librecrawl.comSide by side
| Figure | Crawlr | LibreCrawl |
|---|---|---|
| Price from | $8/mo | Free |
| Free plan | Yes | Yes |
| Free trial | — | — |
| Open source | — | — |
| Web | Yes | Yes |
| Windows | — | Yes |
| macOS | — | Yes |
| Linux | — | Yes |
| API | Yes | Yes |
| Self-hosted | — | Yes |
| Plans published | 5 | 1 |
| Spec score · SEO Crawler Software | 9.0 (#1) | 8.5 (#7) |
| Spec score · SEO tools | 8.5 (#34) | 8.2 (#64) |
| API access | Yes | Yes |
| Exports | The Free plan includes CSV and JSON exports; paid plans add LLM-ready markdown exports and higher-tier bulk export capabilities. | It exports crawl data as CSV, JSON, or XML, with custom field selection and no stated export restrictions. |
| Free plan | Yes | Yes |
| Integrations | The pricing page lists Google PageSpeed Insights for the Starter plan and webhook notifications (Beta) for Growth. | The maker lists PageSpeed metrics and Playwright rendering; its API documentation describes REST endpoints for crawl control, settings, and exports. |
| Intended users | The pricing page describes Starter as suited to single domains and portfolios, Standard to growing teams and agencies, and Growth to high-volume AI and SEO pipelines. | The maker describes LibreCrawl for SEO consultants, agency developers, enterprise SEO teams, and open-source contributors. |
| Support | The pricing comparison lists priority support and dedicated support as plan features. | The maker directs users to GitHub Issues for bug reports and feature requests, and GitHub Discussions for conversations. |
Plans
Crawlr
- FreeFree
- Starter$8 a month
- Standard$73 a month
- Growth$291 a month
- EnterprisePriced on request
In their own words
Crawlr
Crawlr is a website crawler and technical SEO audit tool that finds technical issues, crawl inefficiencies and site architecture problems. It discovers URLs through internal links, sitemaps, canonical links and JavaScript. Crawl settings include robots.txt compliance, rate limiting, inclusion and exclusion rules, and depth controls. Its analysis covers response codes, indexability, metadata, headings, word counts, and internal and external links. Results can be explored through interactive graphs, directory trees, 3D site views and content-cluster visualizations. Crawls can run daily, weekly or on custom schedules, with email notifications on completion. The API can start crawls, check their status, return structured JSON, access historical data and send webhook events. The Free plan is free and includes 500 tokens monthly, one concurrent crawl, CSV and JSON exports, and 15-day history. Paid plans start at $8/mo (annual). The Starter plan lists 5,000 tokens monthly, five concurrent crawls and a 5,000-page maximum per crawl. Unauthenticated sandbox crawls are limited to 25 pages.
LibreCrawl
LibreCrawl is a web-based SEO crawler for auditing and analyzing websites. It checks technical areas such as meta tags, schema markup, hreflang, social tags and PageSpeed metrics. Playwright rendering lets it crawl JavaScript sites built with React, Vue, Angular or Next.js, in headed or headless mode. The maker says memory profiling and virtual scrolling support stable crawls of more than one million URLs. Results can be exported as CSV, JSON or XML, with custom field selection and no stated export restrictions. LibreCrawl is MIT-licensed and can be self-hosted. Its REST API supports crawl control, settings and exports, and uses session-based authentication for every endpoint. Guest API users are limited to three crawls per 24 hours, tracked by IP address. The maker says the software does not track users, collect analytics or send crawl data back to itself, and encourages self-hosting for privacy. It is free, with no subscriptions or paid tiers. The maker directs bug reports and feature requests to GitHub Issues and discussions to GitHub Discussions.