Skip to content
SPECIFICTION
Get listed

FlakyTest.dev vs Qualflare

FlakyTest.dev

flakytest.dev

Qualflare

qualflare.com

Side by side

FigureFlakyTest.devQualflare
Price fromFree$16/mo
Free planYesYes
Free trialYesYes
Open source——
WebYesYes
Windows—Yes
macOS—Yes
Linux—Yes
iOS—Yes
Android—Yes
API—Yes
Plans published28
Spec score · Test Flakiness Management Software7.6 (#19)8.8 (#6)
HeadquartersLjubljana, SloveniaTallinn, Estonia
IntegrationsThe setup guide documents GitHub Actions configuration using a repository secret named FLAKYTEST_SECRET_TOKEN.Official integrations include GitHub, GitLab, Jenkins, Slack, Discord, Jira, and webhooks.
SupportThe documentation directs users needing help, support, or feedback to email the maker.Starter includes community support, Core and Scale include priority email support, and Enterprise includes 24/7 customer support and a 99.9% SLA.

Plans

FlakyTest.dev

  • OSSFree
  • BusinessPriced on request

FlakyTest.dev pricing →

Qualflare

  • Open source planFree
  • StarterFree
  • StarterFree
  • Core$16 a month
  • Core$16 a month
  • Scale$48 a month
  • Scale$48 a month
  • EnterprisePriced on request

Qualflare pricing →

In their own words

FlakyTest.dev

FlakyTest.dev is a web service for managing, monitoring, and reporting on test suite performance, aimed at Python teams handling unreliable test suites. Its pytest plugin tracks tests and sends results when the FLAKYTEST_SECRET_TOKEN environment variable is set. Test ownership routes flaky-test notifications to the person who wrote the test. In the interface, users can mute a test without changing code or opening a pull request; the test keeps running and logging errors but does not fail the CI build. Each test has a run history, and failing tests show standard output, standard error, and other debug information. Run statistics help identify tests that slow builds. Flake detection and a quarantine workflow support unreliable-test management. The setup guide documents GitHub Actions configuration with a repository secret. The OSS plan is free for personal projects, non profits, and open source projects. Business includes a 60-day free trial, with later pricing undetermined.

Visit flakytest.dev

Qualflare

Qualflare is an AI-powered test management and observability platform that collects CI results, clusters failures, detects flaky tests and scores release risk. Teams can manage manual tests in its web application and upload automated results through its CLI, which parses results from 23 testing frameworks. Supported tools include JUnit, pytest, Jest, Playwright, Cypress, Newman, k6 and security tools. Its Quo assistant analyzes coverage gaps, suggests test cases, generates test steps and answers questions about test-management data. AI Failure Clusters group similar failures and offer root-cause summaries, fix suggestions and severity information. Integrations include GitHub, GitLab, Jira, Slack, Discord, Jenkins and custom webhooks. A REST API provides access to test data using project-scoped tokens. Qualflare says customer data stays in the European Union and describes its encryption and access controls, while noting that it does not currently hold SOC 2 Type II or ISO 27001 certification. Mobile test results can be ingested, but the service does not provision devices or run mobile tests. Plans include a free option; paid pricing starts at $16/user/mo (annual), and a 14-day trial is listed.

Visit qualflare.com