Skip to content
SPECIFICTION
Get listed

ArcMutate vs Mutatest

ArcMutate

arcmutate.com

Mutatest

mutatest.readthedocs.io

Side by side

FigureArcMutateMutatest
Price from$8/moFree
Free planYesYes
Free trialYes—
Open source—Yes
WindowsYesYes
macOSYesYes
LinuxYesYes
API—Yes
Self-hostedYesYes
Plans published51
Spec score · Mutation Testing Tools8.6 (#2)8.7 (#1)
PurposeArcMutate extends PiTest to find bugs missed by tests through mutation testing for Java, Kotlin, and Android software.Mutatest is a diagnostic command-line tool for assessing test coverage by checking whether tests detect small code mutations.
SupportThe homepage lists community support with Base and priority support with Pro.The project directs users to its GitHub issue tracker to submit bugs or request features.

Plans

ArcMutate

  • Open SourceFree
  • Base$8 a month
  • Pro$12 a month
  • Startup$15 a month
  • EnterprisePriced on request

ArcMutate pricing →

Mutatest

  • MutatestFree

Mutatest pricing →

In their own words

ArcMutate

ArcMutate has no write-up on Specifiction yet; its figures are above.

Visit arcmutate.com

Mutatest

Mutatest is a free command-line tool for Python projects that checks whether tests catch small changes to code. It creates valid mutations from Python’s Abstract Syntax Tree grammar and applies them to local __pycache__ files rather than changing source files. If coverage data is available, it can limit targets to lines marked as covered. Mutations are sampled randomly, with a seed available to make runs reproducible. Command-line controls include run modes, mutation categories, file exclusions, timeouts, reports, and thresholds for surviving mutants; an API supports custom controls. The documentation describes using test commands such as pytest and coverage data to filter targets. Mutatest can raise an exception when surviving mutants meet a configured threshold, including in automated runs such as CI. It supports Linux, macOS, and Windows, and is free under the MIT License. Installation requires Python 3.7 or 3.8; multiprocessing is available on 3.8, but not 3.7. Repeated test runs can be slow, so it is intended for diagnostics rather than every commit across an entire codebase.

Visit mutatest.readthedocs.io