ArcMutate vs Gambit
ArcMutate
arcmutate.comGambit
certora.comSide by side
| Figure | ArcMutate | Gambit |
|---|---|---|
| Price from | $8/mo | — |
| Free plan | Yes | — |
| Free trial | Yes | — |
| Open source | — | — |
| Windows | Yes | Yes |
| macOS | Yes | Yes |
| Linux | Yes | Yes |
| Self-hosted | Yes | — |
| Plans published | 5 | 0 |
| Spec score · Mutation Testing Tools | 8.6 (#2) | 7.8 (#8) |
| Intended users | The maker describes use cases in automotive safety, banking, and healthcare software testing. | The maker describes Gambit as usable on any Solidity project. |
| Purpose | ArcMutate extends PiTest to find bugs missed by tests through mutation testing for Java, Kotlin, and Android software. | Gambit is an open source Solidity mutation testing tool that evaluates and strengthens a testing suite. |
| Support | The homepage lists community support with Base and priority support with Pro. | Certora's documentation says product questions can be directed to its Help Desk channel on Discord. |
Plans
ArcMutate
- Open SourceFree
- Base$8 a month
- Pro$12 a month
- Startup$15 a month
- EnterprisePriced on request
In their own words
Gambit
Gambit is a free, open-source mutation testing tool for Solidity projects. It generates altered contract versions, called mutants, to measure whether a test suite or formal verification specification detects faults. Gambit locates mutation points by traversing a program’s abstract syntax tree and applying predefined syntax transformations. A declarative configuration language lets users tailor mutations to specific parts of a program. Results can be viewed in a dashboard that summarizes mutant verification and calculates a specification score. Gambit can work with the Certora Prover to evaluate formal specifications; that workflow generates mutants and submits a verification job for each to Certora’s server. The command line includes `mutate` for generating mutants and `summary` for presenting them. A compatible `solc` binary is required for the project being mutated. Gambit supports Solidity and is listed for Linux, macOS, and Windows, though prebuilt binaries are available for Linux x86-64 and Mac; Windows and Linux ARM users must build from source. Function-call and swap-arguments-function mutation operators are disabled. The repository identifies the license as MIT. Certora directs product questions to its Help Desk channel on Discord.