cargo-mutants vs muttest
cargo-mutants
mutants.rsmuttest
jakubsob.github.ioSide by side
| Figure | cargo-mutants | muttest |
|---|---|---|
| Price from | — | — |
| Free plan | — | — |
| Free trial | — | — |
| Open source | — | — |
| Windows | — | Yes |
| macOS | — | Yes |
| Linux | Yes | Yes |
| Plans published | 0 | 0 |
| Spec score · Mutation Testing Tools | 7.5 (#12) | 7.1 (#19) |
| CI | The manual includes instructions and examples for testing mutants in CI, including incremental pull request testing and full development branch testing. | The documentation index links a guide to running muttest in CI, including GitHub Actions and score badges. |
| Purpose | cargo-mutants is a mutation testing tool for Rust that finds places where bugs could be inserted without causing tests to fail. | muttest measures test quality by applying small changes to code and checking whether the test suite catches them. |
In their own words
cargo-mutants
cargo-mutants has no write-up on Specifiction yet; its figures are above.
muttest
muttest is a free R package for mutation testing: it changes selected parts of R code and runs tests to measure which changes the test suite catches. Its mutation score reports the percentage of mutations caught, helping identify weak assertions. Users can choose what to change and where, with mutators for operators, boolean and NA or NULL values, function calls, strings, numbers, indexes, conditions, negation, and return values. Presets group common mutation types, including arithmetic, comparison, logical, numeric, string, and condition changes. Examples use testthat and show how changing comparison operators can expose untested boundary cases. Reports are available in HTML and JSON, with feedback on files that may need stronger assertions. Documentation links a guide for running checks in CI, including GitHub Actions, score badges, and thresholds. A July 2026 update describes parallel execution. The package supports Linux, macOS, and Windows, is licensed under MIT plus a LICENSE file, and requires R version 4.1.0 or later according to its CRAN listing.