Captain vs Mergify
Captain
rwx.com
Mergify
mergify.comSide by side
| Figure | Captain | Mergify |
|---|---|---|
| Price from | Free | $21/mo |
| Free plan | Yes | Yes |
| Free trial | — | Yes |
| Open source | Yes | — |
| Web | Yes | Yes |
| Windows | Yes | — |
| macOS | Yes | — |
| Linux | Yes | — |
| API | Yes | Yes |
| Self-hosted | — | Yes |
| Plans published | 4 | 3 |
| Spec score · Test Flakiness Management Software | 9.4 (#3) | 7.9 (#12) |
| Founded | LinkedIn lists RWX as founded in 2022. | 2018 |
| Headquarters | Columbus, Ohio, United States | Toulouse, France |
| Security | RWX says it is SOC 2 Type 2 compliant and that Drata tests its security and IT infrastructure daily. | The pricing comparison lists data encryption, SSO, and delegated roles, and identifies SOC 2 Type 2 for Max and Enterprise. |
| Support | RWX offers documentation, GitHub issues for open source tools, Discord access to its engineering team, and shared Slack channels for existing customers. | Plans list email support and Slack Connect support, while Enterprise can include optional 24/7 premium support. |
Plans
In their own words
Captain
Captain is an open-source command-line tool for finding flaky tests and managing test execution. It measures test reliability, can retry failed tests, and can quarantine flaky ones to unblock builds. By tracking test runtimes, it balances files across parallel jobs. Framework integrations include xUnit, ExUnit, Ginkgo, go test, Bun, Cucumber, Cypress, Jest, Karma, Mocha, Playwright, TestCafe, Vitest, PHPUnit, pytest, unittest, minitest, and RSpec. CI integrations listed include RWX, GitHub Actions, CircleCI, Buildkite, and GitLab. Framework results can be reviewed in a web interface for managing flakes, retries, quarantine, and suite partitioning. Feature availability varies: xUnit does not include partitioning, and Karma does not list retries or partitioning. The free OSS plan includes file-based configuration, partitioning, flaky-test tracking and quarantine, and retries. Pro costs what you agree with the maker, billed per million test results uploaded, and adds analytics on flaky tests and performance trends with 90-day retention.
Mergify
Mergify automates the path from pull request to a green main branch with merge queues, CI insights, flaky-test tools, and merge protections. Its queue rebases each pull request onto the latest main and merges only when CI passes against the combined state. Teams can combine pull requests into a single CI run; if that batch fails, Mergify can bisect it to locate the culprit. CI Insights reports unreliable jobs, retries them automatically, and provides data for investigating causes.
Merge Protections supports custom rules, scheduled merge windows, freeze periods, and exceptions for urgent fixes. The queue works with any CI that reports status checks to GitHub, while deeper CI Insights integrations are listed for selected providers. Integrations include GitHub, GitHub Enterprise, GitHub Actions, Jenkins, Buildkite, Slack, Datadog, and Terraform, among others. Mergify offers a free plan for open-source projects or private teams of up to five users. Max costs $21 per user per month and includes a 14-day free trial. Enterprise pricing is custom; it can include optional on-premise deployment and dedicated support. Mergify was founded in 2018 and is headquartered in Toulouse, France.