Screaming Frog SEO Log File Analyser vs SEO Log Auditor

Screaming Frog SEO Log File Analyser is a desktop application for examining access logs and understanding search engine and AI bot activity. It installs locally and keeps log event data in a local database. It accepts Apache, W3C Extended, and Amazon Elastic Load Balancing logs, and can verify supported bots to identify spoofed requests. Reports cover crawled URLs, crawl frequency, response errors, redirects, bytes downloaded, and response times. Users can match imported data containing a URLs column against log activity, including crawls, directives, or external link data. Log files can be added by drag and drop, with analysis exported to CSV or Excel. The software can process millions of events, though capacity depends on hard drive space. It runs on Linux, macOS, and Windows. The free plan allows 1,000 log event lines and one project. The paid licence costs $139 per year and includes unlimited events and projects, subject to storage capacity. Free technical support is listed for both versions.

SEO Log Auditor analyzes server access logs to show how search bots crawl a site. It accepts nginx and Apache logs and provides seven views: crawl budget, orphan URLs, status waste, stale pages, performance, bot verification, and parameter traps. Reports can break down requests by user agent and highlight bot-to-human ratios, compare bot-accessed URLs with sitemap and internal-link signals, and rank frequently crawled non-200 responses. Other views flag URLs not visited by a major crawler in 30 or more days and surface slow pages by server response time. Bot verification compares declared user agents with known reverse-DNS signatures to help identify Googlebot or Bingbot impersonation. Parameter analysis surfaces URL patterns with high variation, such as session IDs, filters, and sorting. The app runs locally on a laptop without a database or cloud dependency; its maker describes it as having no telemetry or log upload. A repository workflow also describes Grafana/Loki exports in JSON, CSV, or plain text, plus a sitemap URL; direct Loki API streaming is a roadmap item. It uses Python, Streamlit, and Pandas, and is MIT-licensed.