Cucumber.js vs Testem
Cucumber.js
cucumber.ioTestem
github.comSide by side
| Figure | Cucumber.js | Testem |
|---|---|---|
| Price from | Free | Free |
| Free plan | Yes | Yes |
| Free trial | — | — |
| Open source | — | — |
| Windows | Yes | Yes |
| macOS | Yes | Yes |
| Linux | Yes | Yes |
| Self-hosted | Yes | — |
| Plans published | 2 | 1 |
| Spec score · JavaScript Testing Frameworks | 9.0 (#1) | 7.7 (#10) |
| Integrations | Cucumber says it is not a browser automation tool, but works with browser automation tools such as Selenium WebDriver. | The README describes use with GitHub Actions, Jenkins, and TeamCity. |
| Purpose | Cucumber reads executable specifications written in plain text and checks whether software conforms to them, reporting success or failure for each scenario. | Testem runs JavaScript tests in real desktop browsers, Node, Chrome, or a configured launcher. |
| Security | The project says it has a security policy that explains how to contact maintainers about security issues. | The repository page shows no security advisories. |
Plans
In their own words
Cucumber.js
Cucumber.js checks software against executable specifications written as plain-text scenarios, reporting whether each scenario passes or fails. It is the JavaScript implementation of Cucumber and runs on Node.js. Scenarios use Gherkin syntax and are usually kept in `.feature` files alongside the software in source control. Step definitions connect each Gherkin step to code that carries out its described action; expressions can use Cucumber Expressions or regular expressions, but not both syntaxes in a single expression.
The tool runs feature files from the command line and can run in continuous integration, including parallel execution. Reporter plugins can produce results, and reports can be published to Cucumber Reports with `--publish`. Published reports are public and deleted after 24 hours. Cucumber.js is available as the `@cucumber/cucumber` npm module, installed as a development dependency with npm or Yarn. The setup requires Node.js and one of those package managers. It is free and open source, with Linux, macOS, Windows, and self-hosted platforms listed. It works with browser automation tools, but is not itself one.
Testem
Testem is a JavaScript test runner for running tests in Node.js, real desktop browsers, or a launcher you configure. It supports Jasmine, QUnit, Mocha, and custom framework adapters, and can be used for unit, integration, end-to-end-style, or custom test setups. Browser runs can use Chrome, Firefox, Safari, or Edge, including a Headless Chrome launcher. In development mode, a terminal interface watches project files and reruns tests after relevant changes; CI mode can run tests in available browsers in parallel. Testem includes CI reporters for TAP, dot, xunit, and TeamCity, with custom reporters available. Listed preprocessing support includes Babel, TypeScript, Browserify, ESLint, JSHint, JSLint, and CoffeeScript. Its API provides startDev, startCI, and startServer modes, and coverage reporting is supported. It works with GitHub Actions, Jenkins, and TeamCity. Testem is free and open source under the MIT license, and runs on Linux, macOS, and Windows. It requires a supported Node.js runtime: ^22.17.0, ^24.0.0, or >=26.0.0.