Crab vs Crawlr
Crab
crab.so
Crawlr
crawlr.aiSide by side
| Figure | Crab | Crawlr |
|---|---|---|
| Price from | Free | $8/mo |
| Free plan | Yes | Yes |
| Free trial | — | — |
| Open source | — | — |
| Web | — | Yes |
| Windows | Yes | — |
| macOS | Yes | — |
| Linux | Yes | — |
| API | — | Yes |
| Plans published | 1 | 5 |
| Spec score · SEO Crawler Software | 8.2 (#12) | 9.0 (#1) |
| Spec score · SEO tools | 7.7 (#134) | 8.5 (#34) |
| Exports | Crab can generate a downloadable XML sitemap of crawled URLs. | The Free plan includes CSV and JSON exports; paid plans add LLM-ready markdown exports and higher-tier bulk export capabilities. |
| Free plan | Yes | Yes |
| Integrations | The maker's comparison page lists Google Analytics, Search Console, PageSpeed Insights, and other integrations as “Soon.” | The pricing page lists Google PageSpeed Insights for the Starter plan and webhook notifications (Beta) for Growth. |
| Product | Crab is a desktop SEO crawler for auditing websites. | Crawlr is a website crawler and technical SEO audit tool that identifies technical SEO issues, crawl inefficiencies, and site architecture problems. |
| Support | The homepage directs users with questions to GitHub. | The pricing comparison lists priority support and dedicated support as plan features. |
Plans
Crawlr
- FreeFree
- Starter$8 a month
- Standard$73 a month
- Growth$291 a month
- EnterprisePriced on request
In their own words
Crawlr
Crawlr is a website crawler and technical SEO audit tool that finds technical issues, crawl inefficiencies and site architecture problems. It discovers URLs through internal links, sitemaps, canonical links and JavaScript. Crawl settings include robots.txt compliance, rate limiting, inclusion and exclusion rules, and depth controls. Its analysis covers response codes, indexability, metadata, headings, word counts, and internal and external links. Results can be explored through interactive graphs, directory trees, 3D site views and content-cluster visualizations. Crawls can run daily, weekly or on custom schedules, with email notifications on completion. The API can start crawls, check their status, return structured JSON, access historical data and send webhook events. The Free plan is free and includes 500 tokens monthly, one concurrent crawl, CSV and JSON exports, and 15-day history. Paid plans start at $8/mo (annual). The Starter plan lists 5,000 tokens monthly, five concurrent crawls and a 5,000-page maximum per crawl. Unauthenticated sandbox crawls are limited to 25 pages.