Skip to content
SPECIFICTION
Get listed

Spider-Lens

github.com

Free plan WebWindowsmacOSLinuxSelf-hosted
Visit github.com
Spec score 7.6 #15 of 27 in SEO Log File Analysis Tools

What it is

Spider-Lens is a free, open-source application for analyzing Apache and Nginx server logs. It monitors traffic, HTTP errors, crawler bots and server performance through a dashboard covering requests, human visits, error rates, HTTP status trends, bot distribution and 12-week patterns. Crawler monitoring detects 16 or more bots and shows crawl budget and crawler volume. Performance reports include Time to First Byte by URL, configurable slow thresholds and CSV or Excel export. A sitemap crawler follows internal links and records titles, H1 headings, word counts, canonicals, robots directives and crawl depth. SMTP alerts and webhooks can report 404 spikes, server errors, missing Googlebot and weekly summaries. The project documents Discord, Slack and an MCP server integration. It runs as a Node.js application or native WordPress plugin, with no Node.js required for the plugin. Node deployment requires Node.js 18+, npm 9+ and log access. The interface lists 16 languages and automatic browser-language detection. Nova uses Gemini when configured.

Spec sheet

Purpose
Spider-Lens analyzes Apache and Nginx server logs to monitor traffic, HTTP errors, crawler bots, and server performance.Read 8 Oct 2026 · github.com
Deployment
It is available as a standalone Node.js application and as a native WordPress plugin; the plugin does not require Node.js on the server.Read 8 Oct 2026 · github.com
Integrations
The project documents Discord and Slack webhooks and an MCP server for Claude Code or other MCP-compatible clients.Read 8 Oct 2026 · github.com
Security
Spider-Lens uses JWT authentication with a seven-day token and advises changing the default JWT secret and admin password before deployment.Read 8 Oct 2026 · github.com
Headquarters
Caen, FranceRead 28 Sep 2026 · github.com
Maker
The repository identifies the maker as GDM-Pixel and lists Caen, France.Read 8 Oct 2026 · github.com
AI assistant
Nova uses Google Gemini and requires a Gemini API key; without one, the rest of the application works normally while Nova and AI Analysis show a configuration prompt.Read 8 Oct 2026 · github.com
AI data handling
The README says Nova does not send raw log data to Google and transmits only a compact JSON summary of about 500 tokens per request.Read 8 Oct 2026 · github.com
Alerts
Configurable SMTP email alerts and webhook notifications cover 404 spikes, server errors, missing Googlebot, and weekly reports.Read 8 Oct 2026 · github.com
Crawler monitoring
It detects 16 or more bots and visualizes crawl budget and crawler volume.Read 8 Oct 2026 · github.com
Languages
The interface supports 16 listed languages and can detect the browser language automatically.Read 8 Oct 2026 · github.com
Performance analysis
It reports Time to First Byte per URL and supports configurable slow thresholds plus CSV and Excel exports.Read 8 Oct 2026 · github.com
Requirements
The Node.js application requires Node.js 18 or later, npm 9 or later, and access to Apache or Nginx log files.Read 8 Oct 2026 · github.com
SEO dashboard
The dashboard summarizes requests, human visits, bots, error rates, HTTP status trends, bot distribution, and 12-week trends.Read 8 Oct 2026 · github.com
Site crawler
The sitemap crawler follows internal links and extracts page titles, H1 headings, word counts, canonicals, robots directives, and crawl depth.Read 8 Oct 2026 · github.com

Plans and prices

Open-source self-hosted Free No paid plans or usage limits stated Read 8 Oct 2026 · github.com

Every Spider-Lens plan and price →

Strong points and limits

Strong points

  • Free open-source self-hosted deployment
  • Tracks traffic, errors, bots and performance
  • Sitemap crawler extracts SEO page signals
  • Alerts support SMTP and webhooks
  • WordPress plugin avoids server-side Node.js

Limits

  • Node deployment requires Node.js 18 or later
  • Nova requires a Gemini API key
  • Administrators should change default JWT credentials
  • Requires access to Apache or Nginx logs

Who it suits

Spider-Lens suits site operators who self-host and need log-based SEO, crawler and performance visibility. It also fits teams wanting WordPress deployment, webhook alerts or exports for further analysis.

Verdict

Spider-Lens combines server-log analysis, crawler segmentation, sitemap inspection and alerting without a stated paid tier. Its deployment choices and exports support technical teams comfortable managing their own infrastructure.

Where Specifiction places it

Alternatives to Spider-LensAll alternatives →