CrawlGenius Log Analyzer
crawlgenius.com
What it is
CrawlGenius Log Analyzer analyzes server logs to show how search engines and AI crawlers interact with a website. Its SEO analysis identifies crawl budget waste, HTTP errors, orphan pages, redirect and canonical issues, and fake bots. AI and LLM crawlers are tracked separately from Googlebot, with comparisons between AI and SEO crawling. Dashboards cover crawl coverage, freshness, time to first visit, new URLs, and URLs crawled but never clicked.
Logs can be supplied through a WordPress plugin, server agent, file upload, Amazon S3, or FTP/sFTP deposit; FTP/sFTP is unavailable on the Free plan. Paid plans include a REST API and MCP server. The pricing page says AI crawlers are checked against more than 3,500 official IP ranges and spoofed hits rejected at ingestion. The company says data is hosted in the EU, processed under GDPR, and visitor IPs are truncated before storage; it does not currently hold SOC 2 or ISO 27001 certification. The web-based product is aimed at SEO professionals. The Free plan is free and covers 10,000 log lines monthly, one project, and a seven-day visible window. Starter is €49 a month and Agency is €149 a month, excluding VAT. A guided 30-day trial uses real customer logs and requires no credit card or commitment.
Spec sheet
- Purpose
- CrawlGenius analyzes server logs to show how search engines and AI crawlers interact with websites.Read 7 Oct 2026 · crawlgenius.com
- Intended users
- The company describes CrawlGenius as a tool for SEO professionals and says it began as a log analysis tool for large French websites.Read 7 Oct 2026 · crawlgenius.com
- Trial
- A guided 30-day trial analyzes the customer's real logs and requires no credit card or commitment.Read 7 Oct 2026 · crawlgenius.com
- Integrations
- The pricing page lists a WordPress plugin, server agent, log-file upload, Amazon S3 connector, and FTP/sFTP deposit; FTP/sFTP is unavailable on the Free plan.Read 7 Oct 2026 · crawlgenius.com
- Support
- The founder provides onboarding, training, and technical SEO advice; the Enterprise plan lists a dedicated customer success manager.Read 7 Oct 2026 · crawlgenius.com
- Headquarters
- France, DordogneRead 28 Sep 2026 · crawlgenius.com
- AI crawler tracking
- It tracks AI and LLM crawlers separately from Googlebot and offers AI-versus-SEO comparisons.Read 7 Oct 2026 · crawlgenius.com
- Automation
- Paid plans include a REST API and MCP server, while the Free plan does not.Read 7 Oct 2026 · crawlgenius.com
- Bot verification
- The pricing page says AI crawlers are checked against more than 3,500 official IP ranges and spoofed hits are rejected at ingestion.Read 7 Oct 2026 · crawlgenius.com
- Certifications
- The pricing page states CrawlGenius does not currently hold SOC 2 or ISO 27001 certification.Read 7 Oct 2026 · crawlgenius.com
- Data retention
- Paid plans include 13 months of history, with 90-day and three-year retention options also listed.Read 7 Oct 2026 · crawlgenius.com
- Product limits
- The pricing page says the product does not include keyword rankings, backlink data, or outbound webhooks.Read 7 Oct 2026 · crawlgenius.com
- Security and data location
- The company says data is hosted in the EU, processed under GDPR, and visitor IP addresses are truncated before storage.Read 7 Oct 2026 · crawlgenius.com
- SEO analysis
- The analyzer helps identify crawl budget waste, HTTP errors, orphan pages, redirect and canonical issues, and fake bots.Read 7 Oct 2026 · crawlgenius.com
- URL inventory
- Dashboards track crawl coverage, freshness, time to first visit, new URLs, and URLs crawled but never clicked.Read 7 Oct 2026 · crawlgenius.com
Plans and prices
Strong points and limits
Strong points
- Separates AI crawler activity from Googlebot
- Tracks crawl coverage, freshness, and first visits
- Accepts logs through multiple listed integrations
- Guided 30-day trial requires no credit card
- Paid plans include 13 months of history
Limits
- Free plan limited to 10,000 log lines monthly
- Free plan shows a seven-day window
- FTP/sFTP unavailable on Free plan
- No keyword rankings or backlink data
Who it suits
It suits SEO professionals who need to inspect crawler activity, crawl coverage, and log-based technical issues. The Free plan provides a small-scale way to start, while larger project and log volumes have paid plans.
Verdict
CrawlGenius focuses on server-log analysis, with distinct tracking for AI crawlers and practical crawl-coverage dashboards. Check the plan limits, retention options, and exclusions against the scale and scope of your SEO work.
Where Specifiction places it
- SEO Log File Analysis Tools#2 of 278.3