Log File Bot Traffic Cost Analyzer vs LogLens

Log File Bot Traffic Cost Analyzer examines server logs to summarize AI bot traffic, estimate costs, measure crawl budget, and prepare edge rules. It lists 127 bot signatures and 18 browser patterns, with bandwidth, IPs, and time to first byte by category. Verification uses vendor IP data, TLS, cloud ASN heuristics, and behavior; heuristic results are labeled low confidence, and optional reverse DNS through DoH is listed. Cost estimates use measured bytes and CDN pricing presets, with copyable rules for Cloudflare, Fastly, and AWS. Other modules cover crawl traps, rendering gaps, bot-versus-human performance, traffic bursts, 404 clusters, a GSC overlay, and security anomalies. Inputs include JSON, JSONL/NDJSON, Apache Combined, Nginx, W3C Extended, AWS ALB, Cloudflare Logpush, and gzip files. The project describes processing as client-side, with logs remaining on the user's machine; its only stated network request is for a demo file the user chooses to load. Browser analysis under 500 MB is sampled triage, CLI analysis from 500 MB to 50 GB is described as exact, and BigQuery is for 50 GB and above. It is free, MIT-licensed, and supports CSV and PDF downloads plus generated policy files.

LogLens analyzes CDN and web-server access logs in real time for SEO, crawler, security, and performance insights. It checks claimed bots against providers’ published IP ranges and says its coverage includes more than 200 bots. SEO monitoring connects crawler activity with sitemaps, Google Search Console data, and robots.txt changes; listed security detectors flag hacking probes, bot impersonation surges, and exposed secrets in URLs. The service describes 16 anomaly detectors, with alerts identifying affected IPs, paths, and crawlers. Alert frequency ranges from hourly on Free to every five minutes on Starter and above. Log sources include Cloudflare, AWS CloudFront, Vercel, Kinsta, Shopify, Apache, and Nginx; users can also upload Apache, Nginx, CloudFront, or Events CSV logs without those imports counting against the monthly request quota. Free provides 500K requests per month, one website, and 30 days of history. Solo is $19 a month, and the 14-day full-access trial requires no credit card. After the trial, data remains for seven days before deletion unless the account is claimed.