ArcMutate vs PIT
ArcMutate
arcmutate.com
PIT
pitest.orgSide by side
| Figure | ArcMutate | PIT |
|---|---|---|
| Price from | $8/mo | — |
| Free plan | Yes | — |
| Free trial | Yes | — |
| Open source | — | — |
| Windows | Yes | Yes |
| macOS | Yes | Yes |
| Linux | Yes | Yes |
| Self-hosted | Yes | Yes |
| Plans published | 5 | 0 |
| Spec score · Mutation Testing Tools | 8.6 (#2) | 7.0 (#20) |
| Purpose | ArcMutate extends PiTest to find bugs missed by tests through mutation testing for Java, Kotlin, and Android software. | PIT runs unit tests against automatically modified versions of application code to measure whether tests detect faults. |
| Support | The homepage lists community support with Base and priority support with Pro. | PIT directs users to its Google Group for support questions. |
Plans
ArcMutate
- Open SourceFree
- Base$8 a month
- Pro$12 a month
- Startup$15 a month
- EnterprisePriced on request
In their own words
PIT
PIT is a free mutation-testing tool for Java and JVM bytecode projects. It measures whether unit tests detect faults by running them against modified versions of application code. Configurable bytecode mutations can remove method calls, invert logic, or change return values. PIT selects and prioritizes tests using line coverage, execution speed, and naming conventions, then reports mutation coverage alongside line coverage. It can run from the command line, Ant, or Maven; third-party integrations are listed for Gradle, Eclipse, and IntelliJ. Java is supported directly, and Kotlin use is available through the ArcMutate plugin. PIT supports JUnit 3, JUnit 4, and TestNG; JUnit 5 needs a plugin. Versions 1.4.0 and later require Java 8 or above and JUnit or TestNG on the classpath. Mutation runs can take a long time depending on codebase size and test-suite speed, so PIT recommends focusing on changed code. It mutates bytecode and requires line numbers and source file names in that bytecode.