Skip to content
SPECIFICTION
Get listed

mutator vs pytest-gremlins

mutator

pdonatbouillud.com

pytest-gremlins

github.com

Side by side

Figuremutatorpytest-gremlins
Price from—Free
Free plan—Yes
Free trial——
Open source——
LinuxYesYes
Plans published01
Spec score · Mutation Testing Tools6.9 (#21)7.7 (#10)
InstallationThe released version can be installed from CRAN with install.packages("mutator"), and development versions are available from GitHub and R-universe.The project documents installation with pip, uv, and Poetry.
LicenseThe package is licensed under GPL (>= 3).The project is MIT licensed.
Purposemutator is an automated mutation testing tool for the R language that checks whether a test suite detects systematic changes to source code.pytest-gremlins is a pytest plugin that injects small code mutations and checks whether tests catch them.

Plans

mutator

No plans published.

mutator pricing →

pytest-gremlins

  • pytest-gremlinsFree

pytest-gremlins pricing →

In their own words

mutator

mutator has no write-up on Specifiction yet; its figures are above.

Visit pdonatbouillud.com

pytest-gremlins

pytest-gremlins is a pytest plugin for checking whether an existing test suite catches small changes to code. It runs mutation tests against Python projects and can report results in the console, HTML, or JSON, including multiple formats in one run. Getting started requires Python 3.11 or later, pytest 7.0 or later, and existing tests; installation is documented with pip, uv, and Poetry. The project’s quick-start command is `pytest --gremlins`. To manage execution, it uses mutation switching, coverage-guided test selection, incremental analysis, and parallel execution, and it works with pytest-xdist. Options can be set in `pyproject.toml` or with command-line flags, while inline pragmas can pardon specific mutations. A GitHub Action can run the checks and fail a workflow if its score misses a threshold; CI examples also cover GitLab CI, CircleCI, and Dagger. It is a free, MIT-licensed package for Linux, classified as Alpha. The guide warns that an initial run may take 10–100 times as long as a normal test run, though caching can shorten later runs. It also notes that equivalent mutations can make a perfect score unattainable and unnecessary.

Visit github.com