Mutatest vs Stryker Dashboard

Mutatest is a free command-line tool for Python projects that checks whether tests catch small changes to code. It creates valid mutations from Python’s Abstract Syntax Tree grammar and applies them to local __pycache__ files rather than changing source files. If coverage data is available, it can limit targets to lines marked as covered. Mutations are sampled randomly, with a seed available to make runs reproducible. Command-line controls include run modes, mutation categories, file exclusions, timeouts, reports, and thresholds for surviving mutants; an API supports custom controls. The documentation describes using test commands such as pytest and coverage data to filter targets. Mutatest can raise an exception when surviving mutants meet a configured threshold, including in automated runs such as CI. It supports Linux, macOS, and Windows, and is free under the MIT License. Installation requires Python 3.7 or 3.8; multiprocessing is available on 3.8, but not 3.7. Repeated test runs can be slow, so it is intended for diagnostics rather than every commit across an entire codebase.

Stryker Dashboard is a free, open-source web service for publishing mutation-testing reports and displaying a mutation score badge for repositories. It accepts reports from mutation-testing frameworks that follow the mutation testing report schema, with named language coverage for JavaScript, TypeScript, C#, Scala, and other compatible frameworks. Users enable a repository by signing in with GitHub. Reports can arrive through a Stryker dashboard reporter or by HTTP PUT, authenticated with an API key in STRYKER_DASHBOARD_API_KEY or the X-Api-Key header. Documentation lists full reports, mutation-score reports, and dashboard settings for Stryker, Stryker.NET, and Stryker4s. The API can group multiple reports for one version with an optional module value, useful for monorepos, or accept a score-only report for a badge without storing other report information. Automatic project and version retrieval is documented for Travis, CircleCI, and GitHub Actions across those implementations; Azure DevOps and GitLab CI are supported only for Stryker.NET. The backend currently supports github.com as its Git provider.