Skip to content
SPECIFICTION
Get listed

LittleDarwin vs muttest

LittleDarwin

aliparsai.github.io

muttest

jakubsob.github.io

Side by side

FigureLittleDarwinmuttest
Price fromFree—
Free planYes—
Free trial——
Open source——
Windows—Yes
macOS—Yes
LinuxYesYes
Plans published10
Spec score · Mutation Testing Tools8.3 (#4)7.1 (#19)
InstallThe usage guide says to install LittleDarwin with `pip install littledarwin` and run it as a Python module.The package page provides an R install.packages command using the maker’s r-universe repository and CRAN.
LicenseThe project is free software under the GNU General Public License, version 3 or later.The package is licensed under MIT plus a LICENSE file.
PurposeLittleDarwin generates mutants of Java source code and runs a build command to check whether the test suite detects them.muttest measures test quality by applying small changes to code and checking whether the test suite catches them.

Plans

LittleDarwin

  • Free and open-sourceFree

LittleDarwin pricing →

muttest

No plans published.

muttest pricing →

In their own words

LittleDarwin

LittleDarwin is a Java mutation testing framework written in Python, available for Linux. It generates altered versions, or mutants, of Java source code, then runs a configured build command for each mutant to check whether the test suite detects the change. Its analysis has a mutation phase and a build phase, where each build is checked for success or failure. Users can select null-check or method-level mutation operators, or use all operators. The --higher-order option sets the mutation order, and the guide demonstrates second-order mutants. Project settings include a test project path and test command, build command, working directory, initial build command, cleanup commands, and build timeout. A Maven example runs `mvn clean test` for each mutant. Whitelist filters restrict analysis to selected packages or files, while blacklist filters exclude them. Generated mutants and full-analysis reports go into a LittleDarwinResults directory, and surviving mutants are reported. Installation uses pip, followed by running LittleDarwin as a Python module. The project is free under the GNU General Public License version 3 or later and is supported through donations.

Visit aliparsai.github.io

muttest

muttest is a free R package for mutation testing: it changes selected parts of R code and runs tests to measure which changes the test suite catches. Its mutation score reports the percentage of mutations caught, helping identify weak assertions. Users can choose what to change and where, with mutators for operators, boolean and NA or NULL values, function calls, strings, numbers, indexes, conditions, negation, and return values. Presets group common mutation types, including arithmetic, comparison, logical, numeric, string, and condition changes. Examples use testthat and show how changing comparison operators can expose untested boundary cases. Reports are available in HTML and JSON, with feedback on files that may need stronger assertions. Documentation links a guide for running checks in CI, including GitHub Actions, score badges, and thresholds. A July 2026 update describes parallel execution. The package supports Linux, macOS, and Windows, is licensed under MIT plus a LICENSE file, and requires R version 4.1.0 or later according to its CRAN listing.

Visit jakubsob.github.io