Buildkite vs Testery
Buildkite
buildkite.comTestery
testery.ioSide by side
| Figure | Buildkite | Testery |
|---|---|---|
| Price from | $30/mo | $500/mo |
| Free plan | Yes | Yes |
| Free trial | Yes | — |
| Open source | — | — |
| Web | Yes | Yes |
| Windows | Yes | Yes |
| macOS | Yes | Yes |
| Linux | Yes | Yes |
| API | Yes | Yes |
| Self-hosted | Yes | Yes |
| Plans published | 3 | 4 |
| Spec score · Test Flakiness Management Software | 8.7 (#7) | 7.8 (#16) |
| Integrations | Documented integrations include Slack, PagerDuty, Datadog, Honeycomb, OpenTelemetry, Amazon EventBridge, Artifactory, Docker Hub, and Backstage. | The platform page lists GitHub, Bitbucket, Slack, Microsoft Teams, OpsGenie, and webhooks, including connections to downstream tools such as Zapier. |
| Purpose | Buildkite Pipelines is a platform for building CI/CD workflows, with pipeline steps dispatched as jobs to agents. | Testery is a cloud test orchestration platform designed to run existing automated tests and coordinate testing with CI/CD. |
| Support | The Free Plan includes community support, Pro includes priority email support, and Enterprise includes support with SLA credits and Slack Connect. | The company offers help with product questions, pricing, and demos through its team, and publishes a sales email and phone number. |
Plans
In their own words
Buildkite
Buildkite Pipelines is a CI/CD platform that dispatches pipeline steps as jobs to agents. Agents can be hosted by Buildkite or run in a customer's own infrastructure, including on-premises and cloud environments. Dynamic pipelines can generate and upload steps during a build, allowing a workflow to respond to code changes, test results or runtime logic. Test Engine collects results across testing frameworks and provides tools to track, analyze and act on them. It can detect and quarantine flaky tests, split tests across parallel jobs, and monitor test performance, reliability and ownership. Documented integrations include Slack, PagerDuty, Datadog, Honeycomb, OpenTelemetry, Amazon EventBridge, Artifactory, Docker Hub and Backstage. Buildkite lists TLS 1.2+ for data in transit and AES-256 encryption at rest, along with an annually audited SOC 2 Type II report. The Free Plan costs nothing and allows up to 5 users and 10 concurrent jobs. Pro costs $30 a month, billed per active user monthly, and includes up to 50 users and up to 250 concurrent agents, with 10 included.
Testery
Testery coordinates existing automated tests with CI/CD and distributes them across parallel cloud runs. It lists Playwright, Cypress, Selenium, Robot Framework, Jest, Cucumber/BDD, Postman, and JUnit/TestNG among supported frameworks, and also names WebdriverIO, Nightwatch.js, SpecFlow, PyTest, and NUnit. Flaky-test detection, quarantine, and automatic retries help manage unstable tests. Results can include logs, screenshots, and video, and pull-request status checks can block merges or deployments until tests pass. Integrations include GitHub, Bitbucket, Slack, Microsoft Teams, OpsGenie, and webhooks. Compatible assistants can trigger runs and inspect results through a Claude Code plugin or MCP server. Local runs execute on the user's hardware, with the user choosing which results sync to the cloud. Growth costs $0 per month for 10 test execution hours, then $1.20 per hour; it includes 10 parallel runners. Team costs $500 per month and Scaling costs $950 per month. Cloud tests that must reach firewalled environments require whitelisting Testery static IPs or a tunnel; certificate-based authentication is not supported.