Screaming Frog SEO Log File Analyser vs Website Crawler
Screaming Frog SEO Log File Analyser
screamingfrog.co.ukWebsite Crawler
websitecrawler.orgSide by side
| Figure | Screaming Frog SEO Log File Analyser | Website Crawler |
|---|---|---|
| Price from | $11.58/mo | $10/mo |
| Free plan | Yes | Yes |
| Free trial | — | — |
| Open source | — | — |
| Web | — | Yes |
| Windows | Yes | — |
| macOS | Yes | — |
| Linux | Yes | — |
| API | — | Yes |
| Plans published | 5 | 5 |
| Spec score · SEO tools | 9.1 (#11) | 8.0 (#94) |
| Free plan | Yes | Yes |
| Security and privacy | Imported log data is kept in a local on-disk database according to the documentation, with no cloud-storage workflow described. | The privacy policy says collected crawl data is assigned to the crawl-job starter, user data is not sold or shared with third-party companies, and account data is removed when the account is deleted. |
| Support | Support is offered through email and tickets, with the support page stating a target response within 24 hours. | The maker says it provides email support on weekdays and weekends and replies within two to three hours. |
Plans
Screaming Frog SEO Log File Analyser
- FreeFree
- Paid$139 a year
- Free VersionFree
- Paid licence$139 a year
- Paid Version$139 a year
Website Crawler
- BasicFree
- Starter$10 a month
- Growth$20 a month
- Scale$60 a month
- EnterprisePriced on request
In their own words
Screaming Frog SEO Log File Analyser
Screaming Frog SEO Log File Analyser is a desktop application for examining access logs and understanding search engine and AI bot activity. It installs locally and keeps log event data in a local database. It accepts Apache, W3C Extended, and Amazon Elastic Load Balancing logs, and can verify supported bots to identify spoofed requests. Reports cover crawled URLs, crawl frequency, response errors, redirects, bytes downloaded, and response times. Users can match imported data containing a URLs column against log activity, including crawls, directives, or external link data. Log files can be added by drag and drop, with analysis exported to CSV or Excel. The software can process millions of events, though capacity depends on hard drive space. It runs on Linux, macOS, and Windows. The free plan allows 1,000 log event lines and one project. The paid licence costs $139 per year and includes unlimited events and projects, subject to storage capacity. Free technical support is listed for both versions.
Website Crawler
Website Crawler is a cloud-based website analyzer, scraper and data extractor that crawls pages and reports on-page SEO issues. It can flag broken links, canonical links, duplicate titles and meta tags, missing image alt text, thin content and heading-structure problems. Chrome and HTML crawl modes are available for JavaScript-heavy sites, while HTML mode processes raw HTML only. Users can configure CSS or XPath selectors and JavaScript snippets for custom extraction. Crawl results export to CSV, Markdown or JSON, and the API retrieves structured JSON. The service also offers uptime monitoring and alerts for downtime and SSL certificate expiry; paid-plan intervals range from five minutes to one minute. Integrations include read-only Google Search Console access and Slack notifications. The Basic free plan is free and allows 10 pages per day and one project. Starter is $10 a month for 2,000 pages per month and three projects; Growth is $20 a month for 10,000 pages and ten projects; Scale is $60 a month for 50,000 pages and 50 projects. It works with publicly available HTML-page information and does not submit forms.