EvoMaster vs RestTestGen
EvoMaster
github.comRestTestGen
github.comSide by side
| Figure | EvoMaster | RestTestGen |
|---|---|---|
| Price from | Free | Free |
| Free plan | Yes | Yes |
| Free trial | — | — |
| Open source | — | — |
| Windows | Yes | — |
| macOS | Yes | — |
| Linux | Yes | Yes |
| API | Yes | — |
| Self-hosted | Yes | Yes |
| Plans published | 1 | 1 |
| Spec score · API Testing Tools | 8.4 (#12) | 7.4 (#29) |
| Authentication | It supports authentication headers and cookies, including dynamically obtaining tokens or cookies from a login endpoint. | Authenticated API testing uses user-provided commands that return authentication parameters as JSON, and only one command is used at a time. |
| Founded | 2016 | 2022 |
| Purpose | EvoMaster automatically generates system-level tests through fuzzing for web and enterprise applications. | RestTestGen is a framework and tool for automated black-box end-to-end testing of RESTful web APIs over HTTP. |
| Test generation | It generates JUnit 4 or 5 tests in Java or Kotlin and test suites in Python or JavaScript. | It supports parameter value generation and retrieval, mutation operators, response processors, and configurable operation sorting. |
Plans
In their own words
EvoMaster
EvoMaster is a free, open-source tool that uses fuzzing to generate system-level tests for web and enterprise applications. It targets REST, GraphQL, and RPC APIs, including gRPC and Thrift. Black-box mode works with APIs in any programming language, while white-box mode analyzes JVM bytecode. Generated tests can be JUnit 4 or 5 in Java or Kotlin, or suites in Python or JavaScript. More than 30 oracles check issues including HTTP 500 responses, schema mismatches, BOLA, and SQL injection. White-box testing can analyze SQL and MongoDB interactions with PostgreSQL, MySQL, H2, and MongoDB support. Authentication accepts headers and cookies, including tokens or cookies obtained from a login endpoint. REST testing requires OpenAPI 2.0, 3.0, or 3.1. PyPI is the recommended installation route, with Docker and an uber-fat JAR also available. EvoMaster runs on Linux, macOS, Windows, and self-hosted environments, and integrates with GitHub Actions through a custom action.
RestTestGen
RestTestGen has no write-up on Specifiction yet; its figures are above.