Patrick Stox Log File Analyzer
patrickstox.com
What it is
Patrick Stox Log File Analyzer is a free web tool for examining server access logs and crawler behavior. It automatically detects nginx, Apache, IIS/W3C Extended, and JSON logs, including Cloudflare Logpush. Uploads and pasted logs are parsed in the browser rather than sent to the server; multiple files and large logs streamed in chunks are supported without signup. Reports show crawl budget by bot and site section, crawler activity by page type, wasted URLs, and daily trends when timestamps exist. Users can provide a sitemap or expected URL list for comparison with crawler requests. The tool produces ranked recommendations, copy-ready robots.txt lines, and CSV exports for bots and wasted URLs. It compares request IPs with published crawler ranges and marks crawlers without checkable ranges as unverifiable. An optional suspicious-IP check sends one IP for reverse-DNS and ASN lookup. Analysis covers logged requests only, not indexing outcomes or crawler URL-selection reasons.
Spec sheet
- Purpose
- Analyzes server access logs to show crawler activity, crawl-budget waste, AI crawler traffic, and likely crawler impersonators.Read 4 Oct 2026 · patrickstox.com
- Support
- The page offers bug reports through a private triage queue and feature requests that are reviewed before appearing publicly.Read 4 Oct 2026 · patrickstox.com
- Audience and use cases
- The maker describes use cases including measuring crawler activity, finding crawl-budget waste, comparing AI and search crawlers, and investigating possible bot spoofing.Read 4 Oct 2026 · patrickstox.com
- Crawler verification
- It compares request IPs with crawler operators’ published ranges and marks crawlers without checkable ranges as unverifiable.Read 4 Oct 2026 · patrickstox.com
- Expected URL comparison
- Users can supply a sitemap or expected URL list to compare against crawler requests.Read 4 Oct 2026 · patrickstox.com
- Limits
- It can only analyze requests present in the log and does not report indexing outcomes or explain why a crawler selected a URL.Read 4 Oct 2026 · patrickstox.com
- Local processing
- Log parsing runs in the browser, and pasted or uploaded logs are not sent to the server.Read 4 Oct 2026 · patrickstox.com
- Log formats
- It auto-detects nginx, Apache, IIS/W3C Extended, and JSON logs including Cloudflare Logpush.Read 4 Oct 2026 · patrickstox.com
- Optional network check
- The optional suspicious-IP spot-check sends a single IP to the verifier API for reverse-DNS and ASN lookup.Read 4 Oct 2026 · patrickstox.com
- Privacy detail
- Anonymous run-level outcome counters may be used for aggregate research, with no URLs, domains, IPs, or identifiers included and no statistic released below 100 runs.Read 4 Oct 2026 · patrickstox.com
- Recommendations and export
- It provides ranked recommendations with copy-paste robots.txt lines and CSV exports for bots and wasted URLs.Read 4 Oct 2026 · patrickstox.com
- Reports
- Reports include crawl budget by bot and section, crawler-by-page-type matrix, wasted URLs, and daily trends when logs contain timestamps.Read 4 Oct 2026 · patrickstox.com
- Verification limit
- IP-range matching may miss an impostor using a genuine crawler IP, and crawlers without published ranges cannot be distinguished by range matching alone.Read 4 Oct 2026 · patrickstox.com
Plans and prices
Strong points and limits
Strong points
- Browser-based parsing keeps uploaded logs local
- Automatic detection of four log families
- Crawl-budget and wasted-URL reports
- Robots.txt recommendations and CSV exports
- No signup and multiple-file uploads
Limits
- Only analyzes requests present in logs
- Does not report indexing outcomes
- IP-range checks can miss impostors
- Optional IP check sends data to an API
Who it suits
This tool suits site owners and technical teams measuring crawler activity, finding crawl-budget waste, comparing AI and search crawlers, or investigating possible bot spoofing.
Verdict
Patrick Stox Log File Analyzer provides focused crawler reporting from access logs with local parsing and practical exports. Its conclusions remain limited to recorded requests and the available crawler IP ranges.
Where Specifiction places it
- SEO Log File Analysis Tools#19 of 277.3