EvoMaster vs Fuzzinator
EvoMaster
github.comFuzzinator
fuzzinator.readthedocs.ioSide by side
| Figure | EvoMaster | Fuzzinator |
|---|---|---|
| Price from | Free | Free |
| Free plan | Yes | Yes |
| Free trial | — | — |
| Open source | — | — |
| Web | — | Yes |
| Windows | Yes | Yes |
| macOS | Yes | Yes |
| Linux | Yes | Yes |
| API | Yes | — |
| Self-hosted | Yes | — |
| Plans published | 1 | 1 |
| Spec score · Fuzz Testing Software | 8.3 (#8) | 7.8 (#13) |
| Installation | The recommended install method is PyPI; the project also provides an uber-fat JAR and Docker distribution. | The documentation says to install the latest release with pip install fuzzinator, or install a development checkout locally with pip install . |
| Integrations | It can run in GitHub Actions through a custom action and is distributed as a Docker image. | The framework supports configurable issue trackers, issue exporters, and event listeners; tracker reporting is optional and absent unless configured. |
| Purpose | EvoMaster automatically generates system-level tests through fuzzing for web and enterprise applications. | Fuzzinator automates fuzzing tasks including running test generators against software under test, saving unique issues, reducing failing test cases, updating targets, and scheduling fuzz jobs. |
Plans
In their own words
EvoMaster
EvoMaster is a free, open-source tool that uses fuzzing to generate system-level tests for web and enterprise applications. It targets REST, GraphQL, and RPC APIs, including gRPC and Thrift. Black-box mode works with APIs in any programming language, while white-box mode analyzes JVM bytecode. Generated tests can be JUnit 4 or 5 in Java or Kotlin, or suites in Python or JavaScript. More than 30 oracles check issues including HTTP 500 responses, schema mismatches, BOLA, and SQL injection. White-box testing can analyze SQL and MongoDB interactions with PostgreSQL, MySQL, H2, and MongoDB support. Authentication accepts headers and cookies, including tokens or cookies obtained from a login endpoint. REST testing requires OpenAPI 2.0, 3.0, or 3.1. PyPI is the recommended installation route, with Docker and an uber-fat JAR also available. EvoMaster runs on Linux, macOS, Windows, and self-hosted environments, and integrates with GitHub Actions through a custom action.
Fuzzinator
Fuzzinator is a free, open-source framework for automating fuzzing jobs against software under test. It runs test generators, stores distinct issues, reduces failing test cases, updates targets and schedules jobs across targets and generators without overloading the workstation. Configuration files and Python snippets let users customize workflows; built-in components handle common scenarios.
Its interfaces include an interactive Web UI, an interactive Text UI for Linux and Mac OS X, and a line-based dump mode for consoles on every platform. Issues and execution statistics are stored in MongoDB, with the documented default URI set to mongodb://localhost/fuzzinator. Reporting to trackers such as Bugzilla or GitHub is optional and must be configured. The framework includes only an example random content generator, so users may need external generators or custom components. Documented requirements are Python 3.10 or later and MongoDB 3.6 or later; Java SE 7 is optional for the Picireny reducer. The documentation lists Linux, macOS and Windows among tested platforms.