Flaky Test Detective vs TeamCity
Flaky Test Detective
github.com
TeamCity
jetbrains.comSide by side
| Figure | Flaky Test Detective | TeamCity |
|---|---|---|
| Price from | — | $15/mo |
| Free plan | — | Yes |
| Free trial | — | Yes |
| Open source | — | — |
| Web | — | Yes |
| Windows | — | Yes |
| macOS | — | Yes |
| Linux | — | Yes |
| Android | — | Yes |
| API | — | Yes |
| Self-hosted | — | Yes |
| Plans published | 0 | 8 |
| Spec score · Test Flakiness Management Software | 6.5 (#29) | 8.7 (#8) |
| Purpose | Flaky Test Detective analyzes test results across multiple runs to identify flaky tests and quarantine the worst offenders. | TeamCity is a continuous integration and delivery server for automating builds, tests, and software delivery. |
Plans
TeamCity
- Professional (On-Premises)Free
- Cloud$15 a month
- TeamCity Cloud$15 a month
- Additional build credits$20, paid once
- Additional Cloud build credits$20, paid once
- Additional build agent$359 a year
- Additional On-Premises build agent$359 a year
- Enterprise (On-Premises)$2,399 a year
In their own words
Flaky Test Detective
Flaky Test Detective has no write-up on Specifiction yet; its figures are above.
TeamCity
TeamCity is a continuous integration and delivery server for automating software builds, tests and delivery. Build chains organize pipelines into reusable steps that can run in parallel and share results across configurations. Build caching, artifact dependencies and incremental builds reduce repeated work. TeamCity can test changes before commit and commit them automatically if they pass, while test-history analysis can flag inconsistent results. Pipeline settings can be kept in Kotlin DSL, XML or YAML, or generated from the interface. Supported version control systems include Git, Perforce, Mercurial, Subversion and CVS, with integrations for GitHub, GitLab, Bitbucket and Azure DevOps. Listed infrastructure integrations include AWS, Kubernetes, Google Cloud Platform, Azure Resource Manager and VMware vSphere. TeamCity is available on-premises or in the cloud. The Professional on-premises plan is free forever and includes three build agents, 100 build configurations and 10 pipelines. Cloud costs $15.00 per committer, per month, with a three-committer minimum; its trial is 14 days, while the on-premises Enterprise trial lasts 30 days.