EvoMaster vs Tavern
EvoMaster
github.com
Tavern
tavern.readthedocs.ioSide by side
| Figure | EvoMaster | Tavern |
|---|---|---|
| Price from | Free | Free |
| Free plan | Yes | Yes |
| Free trial | — | — |
| Open source | — | — |
| Windows | Yes | — |
| macOS | Yes | — |
| Linux | Yes | Yes |
| API | Yes | — |
| Self-hosted | Yes | Yes |
| Plans published | 1 | 1 |
| Spec score · API Testing Tools | 8.4 (#12) | 7.9 (#21) |
| Founded | 2016 | 2017 |
| Integrations | It can run in GitHub Actions through a custom action and is distributed as a Docker image. | The documented default backends use requests for HTTP, paho-mqtt for MQTT, grpcio for gRPC, and gql for GraphQL. |
| Purpose | EvoMaster automatically generates system-level tests through fuzzing for web and enterprise applications. | Tavern is a pytest plugin, command-line tool, and Python library for automated API testing using YAML syntax. |
Plans
In their own words
EvoMaster
EvoMaster is a free, open-source tool that uses fuzzing to generate system-level tests for web and enterprise applications. It targets REST, GraphQL, and RPC APIs, including gRPC and Thrift. Black-box mode works with APIs in any programming language, while white-box mode analyzes JVM bytecode. Generated tests can be JUnit 4 or 5 in Java or Kotlin, or suites in Python or JavaScript. More than 30 oracles check issues including HTTP 500 responses, schema mismatches, BOLA, and SQL injection. White-box testing can analyze SQL and MongoDB interactions with PostgreSQL, MySQL, H2, and MongoDB support. Authentication accepts headers and cookies, including tokens or cookies obtained from a login endpoint. REST testing requires OpenAPI 2.0, 3.0, or 3.1. PyPI is the recommended installation route, with Docker and an uber-fat JAR also available. EvoMaster runs on Linux, macOS, Windows, and self-hosted environments, and integrates with GitHub Actions through a custom action.
Tavern
Tavern has no write-up on Specifiction yet; its figures are above.