LibreCrawl vs WebCrawler Pro
LibreCrawl
librecrawl.comWebCrawler Pro
webcrawler.proSide by side
| Figure | LibreCrawl | WebCrawler Pro |
|---|---|---|
| Price from | Free | $1/mo |
| Free plan | Yes | Yes |
| Free trial | — | — |
| Open source | — | — |
| Web | Yes | Yes |
| Windows | Yes | Yes |
| macOS | Yes | Yes |
| Linux | Yes | Yes |
| API | Yes | — |
| Self-hosted | Yes | Yes |
| Plans published | 1 | 7 |
| Spec score · SEO Crawler Software | 8.5 (#7) | 8.6 (#6) |
| Spec score · SEO tools | 8.2 (#64) | 8.9 (#16) |
| Free plan | Yes | Yes |
| Integrations | The maker lists PageSpeed metrics and Playwright rendering; its API documentation describes REST endpoints for crawl control, settings, and exports. | The FAQ names Google sign-in and support for user-provided OpenAI, Gemini, and Anthropic API keys; it says the user’s own key stays on their device. |
| Intended users | The maker describes LibreCrawl for SEO consultants, agency developers, enterprise SEO teams, and open-source contributors. | The maker describes the tool as an independent site crawler and says agencies can send its client-ready reports to clients. |
| Purpose | LibreCrawl is a web-based SEO crawler for website audits and analysis. | WebCrawler Pro crawls websites and scores pages for technical SEO, answer-engine readiness (AEO), and generative engine optimization (GEO). |
| Support | The maker directs users to GitHub Issues for bug reports and feature requests, and GitHub Discussions for conversations. | The contact page says it aims to reply within 1–2 business days, with bug reports and crawl issues usually answered faster. |
Plans
WebCrawler Pro
- Free guestFree
- Free signed inFree
- Paid tokens$1 a month
- Free daily allowanceFree
- GuestFree
- Signed-inFree
- Prepaid crawl tokens$11,000, paid once
In their own words
LibreCrawl
LibreCrawl is a web-based SEO crawler for auditing and analyzing websites. It checks technical areas such as meta tags, schema markup, hreflang, social tags and PageSpeed metrics. Playwright rendering lets it crawl JavaScript sites built with React, Vue, Angular or Next.js, in headed or headless mode. The maker says memory profiling and virtual scrolling support stable crawls of more than one million URLs. Results can be exported as CSV, JSON or XML, with custom field selection and no stated export restrictions. LibreCrawl is MIT-licensed and can be self-hosted. Its REST API supports crawl control, settings and exports, and uses session-based authentication for every endpoint. Guest API users are limited to three crawls per 24 hours, tracked by IP address. The maker says the software does not track users, collect analytics or send crawl data back to itself, and encourages self-hosting for privacy. It is free, with no subscriptions or paid tiers. The maker directs bug reports and feature requests to GitHub Issues and discussions to GitHub Discussions.
WebCrawler Pro
WebCrawler Pro crawls websites and scores pages for technical SEO, answer-engine readiness (AEO) and generative engine optimization (GEO). Technical checks include titles, meta descriptions, H1s, canonicals, Open Graph tags, response times, page size, duplicate content, orphan pages and thin content. AEO checks include FAQ schema and question-based headings; GEO checks cover author attribution, freshness, factual density, authority links and original-research signals. Reports include crawl-depth charts, score distributions, response-time histograms, page breakdowns and site summaries, with PDF, CSV and JSON exports. Signed-in users can draft titles, FAQs, JSON-LD, alt text, internal links and llms.txt using a hosted model or their own API key. HTML mode fetches server responses; DOM Render executes JavaScript before extracting content. Guests receive 50 requests/day and signed-in users 100 requests/day. Paid tokens are listed at $1 a month. It supports Linux, macOS, Windows, web and self-hosting. Pages behind login walls, blocked by robots.txt or protected by advanced bot detection may not be fully crawlable.