Skip to content
SPECIFICTION
Get listed

FlakyTest.dev

flakytest.dev

Free plan Web
Visit flakytest.dev
Spec score 7.6 #19 of 31 in Test Flakiness Management Software

What it is

FlakyTest.dev is a web service for managing, monitoring, and reporting on test suite performance, aimed at Python teams handling unreliable test suites. Its pytest plugin tracks tests and sends results when the FLAKYTEST_SECRET_TOKEN environment variable is set. Test ownership routes flaky-test notifications to the person who wrote the test. In the interface, users can mute a test without changing code or opening a pull request; the test keeps running and logging errors but does not fail the CI build. Each test has a run history, and failing tests show standard output, standard error, and other debug information. Run statistics help identify tests that slow builds. Flake detection and a quarantine workflow support unreliable-test management. The setup guide documents GitHub Actions configuration with a repository secret. The OSS plan is free for personal projects, non profits, and open source projects. Business includes a 60-day free trial, with later pricing undetermined.

Spec sheet

Purpose
FlakyTest is a place to manage, monitor, and report on test suite performance.Read 4 Oct 2026 · flakytest.dev
Intended users
The maker describes FlakyTest as a tool for Python teams dealing with unreliable test suites.Read 4 Oct 2026 · flakytest.dev
Integrations
The setup guide documents GitHub Actions configuration using a repository secret named FLAKYTEST_SECRET_TOKEN.Read 4 Oct 2026 · flakytest.dev
Support
The documentation directs users needing help, support, or feedback to email the maker.Read 4 Oct 2026 · flakytest.dev
Headquarters
Ljubljana, SloveniaRead 28 Sep 2026 · flakytest.dev
Data sent
The pytest plugin sends test results to FlakyTest when the FLAKYTEST_SECRET_TOKEN environment variable is set.Read 4 Oct 2026 · flakytest.dev
Debug details
For failing tests, it shows debug information including standard output and standard error.Read 4 Oct 2026 · flakytest.dev
Language limit
The maker says the product currently focuses on Python projects and plans to support other languages in the future.Read 4 Oct 2026 · flakytest.dev
Maker background
Anže describes himself as a software engineer and indie maker with over ten years of experience shipping products for Silicon Valley startups and growing development teams.Read 4 Oct 2026 · flakytest.dev
Mute tests
Users can mute a test in the UI without code changes or pull requests, while the test continues running and logging errors without failing the CI build.Read 4 Oct 2026 · flakytest.dev
Run statistics
Run statistics can help identify tests that make builds slow.Read 4 Oct 2026 · flakytest.dev
Security and privacy
The privacy policy says the service uses commercially acceptable means to protect personal data but cannot guarantee absolute security.Read 4 Oct 2026 · flakytest.dev
Test framework
Its pytest plugin enables test tracking and management for Python projects.Read 4 Oct 2026 · flakytest.dev
Test history
The product shows all runs for an individual test.Read 4 Oct 2026 · flakytest.dev
Test ownership
It uses test ownership to direct flaky test notifications to the person who wrote the test.Read 4 Oct 2026 · flakytest.dev

Plans and prices

OSS Free Free for personal projects, non profits, and open source projects. Personal projects · non profits · open source projects Read 4 Oct 2026 · flakytest.dev
Business Priced on request Free 60 day trial, help me figure out pricing after that 60 day free trial · pricing after trial to be determined Read 4 Oct 2026 · flakytest.dev

Every FlakyTest.dev plan and price →

Strong points and limits

Strong points

  • Tracks pytest results and individual test history
  • Routes flaky notices through test ownership
  • Mutes tests without code or pull requests
  • Shows failure output and run statistics
  • Offers flake detection and quarantine workflow

Limits

  • Currently focuses on Python projects
  • Business pricing after trial is undetermined
  • Privacy policy cannot guarantee absolute security

Who it suits

It suits Python teams dealing with unreliable test suites, especially those using pytest and GitHub Actions. The OSS plan is for personal projects, non profits, and open source projects.

Verdict

FlakyTest.dev combines pytest tracking, ownership notifications, history, diagnostics, and quarantine controls in a web interface. Its documented scope is Python, with an OSS plan available and Business pricing still to be determined.

Where Specifiction places it

Alternatives to FlakyTest.devAll alternatives →