FlakyWatch vs TeamCity
FlakyWatch
flakywatch.devTeamCity
jetbrains.comSide by side
| Figure | FlakyWatch | TeamCity |
|---|---|---|
| Price from | $29/mo | $15/mo |
| Free plan | Yes | Yes |
| Free trial | Yes | Yes |
| Open source | — | — |
| Web | Yes | Yes |
| Windows | — | Yes |
| macOS | — | Yes |
| Linux | — | Yes |
| Android | — | Yes |
| API | — | Yes |
| Self-hosted | — | Yes |
| Plans published | 3 | 8 |
| Spec score · Test Flakiness Management Software | 7.8 (#15) | 8.7 (#8) |
| Integrations | The site lists GitHub Actions and GitHub issues; Slack integration is marked coming soon on the Team plan. | Built-in integrations use UI controls or specialized REST endpoints, and additional plugins can extend coverage. |
| Support | FlakyWatch lists email support on Starter, priority support on Team, and says it aims to respond to inquiries within 48 hours during business days. | The support page lists an issue tracker, support requests, documentation, and a community forum; Enterprise support offers 24/7 availability and guaranteed response times. |
| What it does | FlakyWatch monitors GitHub Actions test results, detects and classifies flaky tests, estimates CI and developer time costs, and tracks them as GitHub issues. | TeamCity is JetBrains’ continuous integration and continuous delivery server for automating builds, tests and deployments. |
Plans
TeamCity
- Professional (On-Premises)Free
- Cloud$15 a month
- TeamCity Cloud$15 a month
- Additional build credits$20, paid once
- Additional Cloud build credits$20, paid once
- Additional build agent$359 a year
- Additional On-Premises build agent$359 a year
- Enterprise (On-Premises)$2,399 a year
In their own words
FlakyWatch
FlakyWatch monitors GitHub Actions test results, classifies unstable tests, estimates CI and developer time costs, and tracks flakes as GitHub issues. Users upload JUnit XML through the FlakyWatch GitHub App and a workflow step; the service says agents and configuration files are unnecessary. Supported runners include pytest, Jest, JUnit, RSpec, and other JUnit-compatible tools. Tests receive stable, flaky, broken, or newly unstable labels with confidence scores. Generated GitHub issues include classification, impact, and recommended next steps, and can reopen when a flake returns. Dashboard metrics include blocked runs, main failures, affected branches, and cost per test. An optional weekly email digest reports new unstable tests, cost trends, and open issues. The free plan costs nothing and covers one repository with 14-day history. Starter costs $29 a month for five repositories and 30-day history; Team costs $79 a month for 20 repositories and 90-day history. Slack and CSV export are marked coming soon on Team.
TeamCity
TeamCity is a continuous integration and delivery server for automating software builds, tests and delivery. Build chains organize pipelines into reusable steps that can run in parallel and share results across configurations. Build caching, artifact dependencies and incremental builds reduce repeated work. TeamCity can test changes before commit and commit them automatically if they pass, while test-history analysis can flag inconsistent results. Pipeline settings can be kept in Kotlin DSL, XML or YAML, or generated from the interface. Supported version control systems include Git, Perforce, Mercurial, Subversion and CVS, with integrations for GitHub, GitLab, Bitbucket and Azure DevOps. Listed infrastructure integrations include AWS, Kubernetes, Google Cloud Platform, Azure Resource Manager and VMware vSphere. TeamCity is available on-premises or in the cloud. The Professional on-premises plan is free forever and includes three build agents, 100 build configurations and 10 pipelines. Cloud costs $15.00 per committer, per month, with a three-committer minimum; its trial is 14 days, while the on-premises Enterprise trial lasts 30 days.