Website Crawler
websitecrawler.org
What it is
Website Crawler is a cloud-based website analyzer, scraper and data extractor that crawls pages and reports on-page SEO issues. It can flag broken links, canonical links, duplicate titles and meta tags, missing image alt text, thin content and heading-structure problems. Chrome and HTML crawl modes are available for JavaScript-heavy sites, while HTML mode processes raw HTML only. Users can configure CSS or XPath selectors and JavaScript snippets for custom extraction. Crawl results export to CSV, Markdown or JSON, and the API retrieves structured JSON. The service also offers uptime monitoring and alerts for downtime and SSL certificate expiry; paid-plan intervals range from five minutes to one minute. Integrations include read-only Google Search Console access and Slack notifications. The Basic free plan is free and allows 10 pages per day and one project. Starter is $10 a month for 2,000 pages per month and three projects; Growth is $20 a month for 10,000 pages and ten projects; Scale is $60 a month for 50,000 pages and 50 projects. It works with publicly available HTML-page information and does not submit forms.
Spec sheet
- Product
- Website Crawler is a cloud-based website analyzer, scraper, and data extractor that crawls site pages and reports on-page SEO issues.Read 29 Sep 2026 · websitecrawler.org
- Intended users
- The maker describes the service for website owners, people analyzing CMS or custom-built sites, and researchers or students needing web datasets for AI projects.Read 29 Sep 2026 · websitecrawler.org
- Free plan
- YesRead 21 Sep 2026 · websitecrawler.org
- Paid from
- 20Read 21 Sep 2026 · websitecrawler.org
- Integrations
- The privacy policy describes Google Search Console integration with read-only account access and a Slack integration for notifications to a selected channel.Read 29 Sep 2026 · websitecrawler.org
- Support
- The maker says it provides email support on weekdays and weekends and replies within two to three hours.Read 29 Sep 2026 · websitecrawler.org
- API access
- YesRead 21 Sep 2026 · websitecrawler.org
- Crawl scope limit
- The service works with publicly available information on HTML pages and does not automatically fill in or submit forms.Read 29 Sep 2026 · websitecrawler.org
- Custom extraction
- Users can configure extraction with CSS or XPath selectors and JavaScript snippets.Read 29 Sep 2026 · websitecrawler.org
- Exports and API
- Crawl data can be exported in CSV, Markdown, or JSON, and the API retrieves structured JSON data.Read 29 Sep 2026 · websitecrawler.org
- Free-plan limits
- The free plan allows 10 URLs per day, while features marked Demo expose data for only five URLs on the project page and five records in settings.Read 29 Sep 2026 · websitecrawler.org
- JavaScript crawling
- It can render JavaScript-heavy sites and offers Chrome and HTML crawl modes; HTML mode processes raw HTML only.Read 29 Sep 2026 · websitecrawler.org
- Monitoring
- The service offers uptime monitoring and alerts for downtime and SSL certificate expiry; paid plan monitoring intervals range from five minutes to one minute.Read 29 Sep 2026 · websitecrawler.org
- Security and privacy
- The privacy policy says collected crawl data is assigned to the crawl-job starter, user data is not sold or shared with third-party companies, and account data is removed when the account is deleted.Read 29 Sep 2026 · websitecrawler.org
- SEO audits
- The service identifies issues including broken links, canonical links, duplicate titles and meta tags, missing image alt tags, thin content, and heading structure problems.Read 29 Sep 2026 · websitecrawler.org
Plans and prices
Strong points and limits
Strong points
- Finds a range of on-page SEO issues
- Supports CSS, XPath and JavaScript-based extraction
- Exports crawl data in CSV, Markdown and JSON
- Offers uptime alerts and SSL expiry monitoring
Limits
- Free plan allows 10 pages per day
- Does not automatically fill in or submit forms
- HTML crawl mode processes raw HTML only
Who it suits
Website Crawler suits site owners auditing on-page SEO, people analyzing CMS or custom-built sites, and researchers or students assembling web datasets. Its API and extraction options may also suit users who need structured crawl output.
Verdict
Website Crawler combines SEO checks, custom extraction, exports and monitoring, with a free entry plan and paid page quotas. Its crawl scope is limited to public HTML information, and it does not submit forms.
Where Specifiction places it
- SEO tools#94 of 2458.0
- SEO Audit Software#24 of 357.7