Web Test Runner

Web Test Runner is a browser-based test runner for web applications, best suited to developers who need to check behavior across real browser engines. Its free, open-source model is compelling; its main caveat is that coverage instrumentation defaults to Chromium.

Overview

Tests run in parallel, with each file receiving its own browser environment. That helps isolate test files while making browser-focused suites a practical fit for projects where execution context matters. Watch mode reruns tests when files change, reducing the friction of iterating on a suite.

Install it as an npm development dependency with @web/test-runner. Modern Web publishes packages under the @web namespace and directs users to GitHub for help and feedback. The project is MIT-licensed, and its maintainers invite contributions to the documentation.

Key features

Browser execution and diagnostics

Documented launchers include Puppeteer, Playwright, Selenium, BrowserStack, and WebdriverIO. Playwright supports Chromium, Firefox, and WebKit, and BrowserStack enables remote runs, including against older browser versions. This breadth helps teams choose an execution environment suited to their browser needs, though the launcher choice is part of the project setup.

Debug mode opens a visible browser window with developer tools. The runner also reports browser logs, 404 responses, and errors, making it better suited to investigating failures tied to browser behavior than a runner that only returns a pass-or-fail result.

Coverage, mocking, and frameworks

The command line supports interactive watch mode and code coverage profiling. Coverage reports and configurable thresholds give teams a way to track coverage against project expectations, but default instrumentation uses Chromium, which matters when other browser engines are the target. ES modules can be mocked using import maps.

The documentation covers Mocha integration and explains how to write a custom test framework. The runner is powered by esbuild and Rollup plugins, and Playwright can be integrated with GitHub Actions through Microsoft's Playwright Action.

Pricing

The Open source plan costs free. It is an MIT-licensed project installed as an npm development dependency, with no paid tier or usage caps stated. That makes it a straightforward fit for individual developers and teams comfortable maintaining their own test setup; there is no higher-priced plan described for readers seeking a different support or service arrangement.

Platforms

Web Test Runner supports Linux, macOS, Windows, web, and self-hosted environments. Its documented Playwright launcher covers Chromium, Firefox, and WebKit. BrowserStack's remote launcher is useful when testing older browser versions, while the Chromium default for coverage instrumentation is a limitation for teams expecting coverage runs across engines.

Who it's for

Choose Web Test Runner if browser execution, isolated parallel test files, and actionable browser diagnostics matter to your web application workflow. It is less suited to teams that want coverage instrumentation to default across multiple browser engines or prefer a hosted, managed test service rather than an npm development dependency.

Pros and cons

Pros

Broad launcher options: documented integrations include local browser launchers and remote BrowserStack runs, including for older browser versions.

Isolated parallel execution: each test file has its own browser environment, and files can run in parallel.

Useful debugging signals: visible-browser debug mode is paired with reports of logs, 404s, and errors.

Free and permissively licensed: the MIT-licensed project is available at no charge.

Cons

Coverage defaults to Chromium: teams targeting Firefox or WebKit need to account for that instrumentation constraint.

Launcher choice requires setup: the range of browser and remote launchers means teams must select and configure the fit for their project.

Alternatives

JavaScript Testing Frameworks is a useful broader starting point for comparing options. Choose QUnit for an open-source JavaScript testing framework distributed via CDN, npm, and Yarn. Karma is another free, MIT-licensed option, but it is deprecated and receives no new features or general bug fixes. Consider Intern as another free testing option from SitePen and the OpenJS Foundation. Vitest is a free, open-source alternative if you want a different JavaScript testing tool. Cucumber.js is available as an npm development dependency. Pure Test is a free Apache-2.0 open-source option. Testem is a free, MIT-licensed JavaScript test runner. QUnitX is another project by its repository owner.

Verdict

Web Test Runner is a strong choice for developers who want a free, browser-centered test runner with parallel isolation, watch mode, and diagnostic detail. Its mix of launcher options is a persuasive reason to choose it; look elsewhere if cross-engine coverage instrumentation is essential or you want a managed testing service.