Flake

Spec sheet

Purpose

Flake detects, diagnoses, and replays flaky tests by repeatedly running test suites under controlled variations.Read 30 Sep 2026 · github.com

Integrations

Flake is available as a GitHub Action that can write a Markdown job summary, annotate flaky test files, and upload JSON, Markdown, or SARIF reports as an artifact.Read 30 Sep 2026 · github.com

Privacy

The README says Flake does not upload source or test output, and stores its state in a local SQLite database in the OS application-data directory.Read 30 Sep 2026 · github.com

License

The repository lists the MIT license.Read 30 Sep 2026 · github.com

Availability

The README describes Flake as a cross-platform Go CLI and provides a `go install` command and released binaries for OS and architecture combinations.Read 30 Sep 2026 · github.com

Controlled variations

Runs can vary test order, seeds, sequential or parallel execution, worker count, timezone, locale, temporary-directory handling, and allowed environment variables.Read 30 Sep 2026 · github.com

Dependencies

Flake uses test runners and plugins already installed in the project and does not install dependencies or plugins.Read 30 Sep 2026 · github.com

Detection

It computes failure rates and normalizes output into stable signatures to group failures into incidents.Read 30 Sep 2026 · github.com

Detection and replay

Flake computes failure rates, minimizes reproduction conditions, reports suspected causes from observed evidence, and saves replay commands.Read 30 Sep 2026 · github.com

Diagnosis

For ordering failures, Flake uses delta debugging to reduce the preceding test sequence and verify a minimized reproduction.Read 30 Sep 2026 · github.com

Hosting model

The README states that Flake has no web dashboard, server, or cloud service.Read 30 Sep 2026 · github.com

Limitations

With Jest, Flake cannot force an exact cross-file test order because Jest's own sequencer chooses it.Read 30 Sep 2026 · github.com

Local execution

Flake is a cross-platform Go command-line tool, with released binaries available for operating systems and architectures on its releases page.Read 30 Sep 2026 · github.com

Replay

Each incident stores a run specification, and `flake replay <id>` rebuilds the recorded invocation.Read 30 Sep 2026 · github.com

Secret handling

Flake redacts likely-secret values before storing them and rejects secret-looking variable names in the environment allowlist.Read 30 Sep 2026 · github.com

Security controls

Flake rejects secret-looking variable names from its environment allowlist and does not vary or store likely-secret variables by default.Read 30 Sep 2026 · github.com

Supported runners

It supports pytest, Jest, and Vitest test suites.Read 30 Sep 2026 · github.com

Supported test runners

Flake supports pytest, Jest, and Vitest.Read 30 Sep 2026 · github.com

Where Specifiction places it

• CI Failure Analysis And Flaky Test Tools#10 of 217.2
• Test Flakiness Management Software#21 of 317.3