Skip to content
SPECIFICTION
Get listed

MutPy vs muttest

MutPy

github.com

muttest

jakubsob.github.io

Side by side

FigureMutPymuttest
Price fromFree—
Free planYes—
Free trial——
Open source——
Windows—Yes
macOS—Yes
LinuxYesYes
Self-hostedYes—
Plans published10
Spec score · Mutation Testing Tools7.9 (#7)7.1 (#19)
Intended usersPyPI classifies the package for developers and software testing.The project describes mutation testing as a way to find weak assertions in test suites, including suites generated with LLMs.
LicenseThe project is licensed under the Apache License, Version 2.0.The package is licensed under MIT plus a LICENSE file.
PurposeMutPy is a mutation testing tool for Python source code that evaluates the quality of software tests.muttest measures test quality by applying small changes to code and checking whether the test suite catches them.

Plans

MutPy

  • MutPyFree

MutPy pricing →

muttest

No plans published.

muttest pricing →

In their own words

MutPy

MutPy is a mutation testing tool for Python that checks whether a test suite catches changes to its source code. It creates mutations at the abstract syntax tree level, then runs tests to reveal which changes go undetected. The project describes compatibility with Python 3.3 and later. It uses unittest by default, while pytest support is experimental. Reports can be generated in YAML or HTML, and coverage analysis can restrict mutation to code exercised by tests. Users can also select or disable operators and sample a percentage of mutants. MutPy supports higher order mutations and includes standard and experimental operator sets. Installation is documented through pip from PyPI or from the repository source. The software is free at free and licensed under Apache License 2.0. PyPI lists version 0.6.1, released November 17, 2019, as the latest release. The README warns that disabling stdout can damage tests that interact with sys.stdout.

Visit github.com

muttest

muttest is a free R package for mutation testing: it changes selected parts of R code and runs tests to measure which changes the test suite catches. Its mutation score reports the percentage of mutations caught, helping identify weak assertions. Users can choose what to change and where, with mutators for operators, boolean and NA or NULL values, function calls, strings, numbers, indexes, conditions, negation, and return values. Presets group common mutation types, including arithmetic, comparison, logical, numeric, string, and condition changes. Examples use testthat and show how changing comparison operators can expose untested boundary cases. Reports are available in HTML and JSON, with feedback on files that may need stronger assertions. Documentation links a guide for running checks in CI, including GitHub Actions, score badges, and thresholds. A July 2026 update describes parallel execution. The package supports Linux, macOS, and Windows, is licensed under MIT plus a LICENSE file, and requires R version 4.1.0 or later according to its CRAN listing.

Visit jakubsob.github.io