Crawler Log Analyser vs Patrick Stox Log File Analyzer
Crawler Log Analyser
github.comPatrick Stox Log File Analyzer
patrickstox.comSide by side
| Figure | Crawler Log Analyser | Patrick Stox Log File Analyzer |
|---|---|---|
| Price from | — | Free |
| Free plan | — | Yes |
| Free trial | — | — |
| Open source | — | — |
| Web | — | Yes |
| Linux | Yes | — |
| Self-hosted | Yes | — |
| Plans published | 0 | 1 |
| Spec score · SEO Log File Analysis Tools | 7.7 (#9) | 7.3 (#19) |
| Purpose | The project describes itself as operational SEO observability for self-hosted static sites running nginx. | Analyzes server access logs to show crawler activity, crawl-budget waste, AI crawler traffic, and likely crawler impersonators. |
| Reports | It emits text, Markdown, or JSON reports and can exit non-zero on critical findings for cron and CI use. | Reports include crawl budget by bot and section, crawler-by-page-type matrix, wasted URLs, and daily trends when logs contain timestamps. |
| Support | The README welcomes pull requests and says project review may be slow because it is maintained as time permits. | The page offers bug reports through a private triage queue and feature requests that are reviewed before appearing publicly. |
Plans
In their own words
Crawler Log Analyser
Crawler Log Analyser has no write-up on Specifiction yet; its figures are above.
Patrick Stox Log File Analyzer
Patrick Stox Log File Analyzer is a free web tool for examining server access logs and crawler behavior. It automatically detects nginx, Apache, IIS/W3C Extended, and JSON logs, including Cloudflare Logpush. Uploads and pasted logs are parsed in the browser rather than sent to the server; multiple files and large logs streamed in chunks are supported without signup. Reports show crawl budget by bot and site section, crawler activity by page type, wasted URLs, and daily trends when timestamps exist. Users can provide a sitemap or expected URL list for comparison with crawler requests. The tool produces ranked recommendations, copy-ready robots.txt lines, and CSV exports for bots and wasted URLs. It compares request IPs with published crawler ranges and marks crawlers without checkable ranges as unverifiable. An optional suspicious-IP check sends one IP for reverse-DNS and ASN lookup. Analysis covers logged requests only, not indexing outcomes or crawler URL-selection reasons.