Screaming Frog SEO Log File Analyser vs SiteOne Crawler
Screaming Frog SEO Log File Analyser
screamingfrog.co.ukSiteOne Crawler
crawler.siteone.ioSide by side
| Figure | Screaming Frog SEO Log File Analyser | SiteOne Crawler |
|---|---|---|
| Price from | $11.58/mo | Free |
| Free plan | Yes | Yes |
| Free trial | — | — |
| Open source | — | — |
| Windows | Yes | Yes |
| macOS | Yes | Yes |
| Linux | Yes | Yes |
| API | — | Yes |
| Self-hosted | — | Yes |
| Plans published | 5 | 2 |
| Spec score · SEO tools | 9.1 (#11) | 8.0 (#93) |
| Spec score · SEO Crawler Software | 8.7 (#3) | 7.8 (#22) |
| Audience | The maker describes the software as specifically designed for SEOs analysing search and AI bot activity. | The maker identifies website owners, developers, QA engineers, administrators, DevOps practitioners, and consultants as intended users. |
| Free plan | Yes | Yes |
| Purpose | The desktop application analyses access logs to give SEOs insight into search engine and AI bot crawl activity. | SiteOne Crawler crawls websites and analyzes SEO, performance, accessibility, security, best practices, and content, then produces an interactive HTML report or text and JSON output. |
| Support | Support is offered through email and tickets, with the support page stating a target response within 24 hours. | The maker lists GitHub Issues for bugs and feature requests and GitHub Discussions for questions and discussion. |
Plans
Screaming Frog SEO Log File Analyser
- FreeFree
- Paid$139 a year
- Free VersionFree
- Paid licence$139 a year
- Paid Version$139 a year
In their own words
Screaming Frog SEO Log File Analyser
Screaming Frog SEO Log File Analyser is a desktop application for examining access logs and understanding search engine and AI bot activity. It installs locally and keeps log event data in a local database. It accepts Apache, W3C Extended, and Amazon Elastic Load Balancing logs, and can verify supported bots to identify spoofed requests. Reports cover crawled URLs, crawl frequency, response errors, redirects, bytes downloaded, and response times. Users can match imported data containing a URLs column against log activity, including crawls, directives, or external link data. Log files can be added by drag and drop, with analysis exported to CSV or Excel. The software can process millions of events, though capacity depends on hard drive space. It runs on Linux, macOS, and Windows. The free plan allows 1,000 log event lines and one project. The paid licence costs $139 per year and includes unlimited events and projects, subject to storage capacity. Free technical support is listed for both versions.
SiteOne Crawler
SiteOne Crawler is a free website crawler and audit tool that examines SEO, performance, accessibility, security, best practices, and content. It produces an interactive HTML report or text and JSON output, and assigns a quality score from 0.0 to 10.0 across five areas: performance, SEO, security, accessibility, and best practices. It can save a static copy of a website for offline browsing, turn a whole site into Markdown, and generate llms.txt. An optional Chromium mode renders JavaScript-driven pages before crawling. The native Rust binary runs on Windows, macOS, and Linux, with desktop and command-line variants; it has no runtime dependencies. API access and self-hosting are also listed. A CI/CD quality gate offers configurable thresholds, JUnit XML, GitHub annotations, and exit code 10 when checks fail. Reports can be shared through a free service using secure URLs with optional expiration and password protection. The default crawl uses three workers and no more than 10 requests per second combined. Plans are listed at free.