EvoMaster vs EvoMaster
EvoMaster
github.comEvoMaster
evomaster.orgSide by side
| Figure | EvoMaster | EvoMaster |
|---|---|---|
| Price from | Free | Free |
| Free plan | Yes | Yes |
| Free trial | — | — |
| Open source | — | — |
| Windows | Yes | Yes |
| macOS | Yes | Yes |
| Linux | Yes | Yes |
| API | Yes | Yes |
| Self-hosted | Yes | Yes |
| Plans published | 1 | 1 |
| Spec score · Monorepo Management Tools | 8.2 (#8) | 8.1 (#11) |
| Spec score · Fuzz Testing Software | 8.3 (#8) | 8.2 (#9) |
| Spec score · API Testing Tools | 8.4 (#12) | 8.3 (#15) |
| Authentication | It supports authentication headers and cookies, including dynamically obtaining tokens or cookies from a login endpoint. | It supports authentication headers and cookies, including declarative login endpoint configuration to obtain credentials dynamically for each test execution. |
| Database support | For white-box testing, it can analyze SQL and MongoDB interactions and supports PostgreSQL, MySQL, H2, and MongoDB. | For white-box testing, it supports PostgreSQL, MySQL, H2 and MongoDB communications and can generate database initialization for tests. |
| Fault detection | Its heuristics check for issues including HTTP 500 responses, schema mismatches, BOLA, and SQL injection, using more than 30 oracles. | The project says it uses more than 30 oracles to detect faults including HTTP status problems, schema mismatches, BOLA and SQL injection. |
| Founded | 2016 | 2016 |
| Purpose | EvoMaster automatically generates system-level tests through fuzzing for web and enterprise applications. | EvoMaster automatically generates system-level test cases for web and enterprise applications by fuzzing APIs. |
| Security and privacy | The project says it has no telemetry and does not require internet services beyond the application being tested. | The project states that it has no telemetry and does not require external internet services beyond the application under test, and says it can run in-house without leaking intellectual property to external parties. |
| Test generation | It generates JUnit 4 or 5 tests in Java or Kotlin and test suites in Python or JavaScript. | It uses evolutionary algorithms, dynamic program analysis and AI heuristics to evolve test cases and improve measures such as code coverage and fault detection. |
| Testing modes | Black-box mode can run against APIs in any programming language, while white-box mode analyzes JVM application bytecode. | It supports black-box testing for APIs regardless of implementation language and white-box testing for APIs compiled to the JVM, such as Java and Kotlin. |
Plans
In their own words
EvoMaster
EvoMaster is a free, open-source tool that uses fuzzing to generate system-level tests for web and enterprise applications. It targets REST, GraphQL, and RPC APIs, including gRPC and Thrift. Black-box mode works with APIs in any programming language, while white-box mode analyzes JVM bytecode. Generated tests can be JUnit 4 or 5 in Java or Kotlin, or suites in Python or JavaScript. More than 30 oracles check issues including HTTP 500 responses, schema mismatches, BOLA, and SQL injection. White-box testing can analyze SQL and MongoDB interactions with PostgreSQL, MySQL, H2, and MongoDB support. Authentication accepts headers and cookies, including tokens or cookies obtained from a login endpoint. REST testing requires OpenAPI 2.0, 3.0, or 3.1. PyPI is the recommended installation route, with Docker and an uber-fat JAR also available. EvoMaster runs on Linux, macOS, Windows, and self-hosted environments, and integrates with GitHub Actions through a custom action.
EvoMaster
EvoMaster automatically generates system-level tests for web and enterprise applications by fuzzing APIs. It targets REST, GraphQL, and RPC APIs, including gRPC and Thrift. Black-box testing works across implementation languages; white-box testing is available for APIs compiled to the JVM, such as Java and Kotlin. The tool evolves test cases using evolutionary algorithms, dynamic program analysis, and AI heuristics to improve measures such as code coverage and fault detection. Its project describes more than 30 fault-detection oracles, covering issues such as HTTP status problems, schema mismatches, BOLA, and SQL injection. Generated results can include JUnit 4 or 5 tests in Java or Kotlin, Python or JavaScript test suites, and an interactive HTML report by default. White-box testing supports PostgreSQL, MySQL, H2, and MongoDB communications and can generate database initialization. Authentication headers and cookies are supported, as is dynamic credential retrieval through configured login endpoints. EvoMaster is free, has no telemetry, and says it needs no external internet services beyond the application under test. It can run on Linux, macOS, Windows, or self-hosted; PyPI is the recommended installation route, with a JAR and Docker image also available.