BDDX vs Concordion
BDDX
bddtests.comConcordion
concordion.orgSide by side
| Figure | BDDX | Concordion |
|---|---|---|
| Price from | $9.99/mo | Free |
| Free plan | Yes | Yes |
| Free trial | — | — |
| Open source | — | — |
| Web | Yes | — |
| Windows | — | Yes |
| macOS | — | Yes |
| Linux | — | Yes |
| Self-hosted | — | Yes |
| Plans published | 4 | 1 |
| Spec score · BDD Testing Tools | 8.2 (#5) | 8.8 (#3) |
| Founded | 2011 | 2006 |
| Integrations | The documentation describes creating Jira tasks and GitHub or GitLab issues from detected defects; Jira tasks can be created automatically for failed tests. | The Java integration page lists IntelliJ IDEA, Eclipse, Gradle, Maven, command line, Jenkins, and Spring integrations. |
| Intended users | The homepage describes the Scale plan as intended for a test team running automated tests daily. | The site identifies stakeholders, analysts, developers, and testers as users Concordion is for. |
| Purpose | BDDX creates and runs Behavior-Driven Development tests and summarizes failures. | Concordion is an open-source tool for automating Specification by Example and creating living documentation. |
Plans
In their own words
BDDX
BDDX creates and runs Behavior-Driven Development tests written in Cucumber’s Gherkin plain-text language, then summarizes test failures and their causes. Users can upload test files in bulk and run them line by line, pausing and resuming a bulk run from a checkpoint. The documented workflow connects a cloud BDDX project and API key with the CLI: the CLI runs tests in a repository and uploads results to the cloud. Its installation command is `npm i bddx`. Documentation describes creating Jira tasks and GitHub or GitLab issues from detected defects, and Jira tasks can be created automatically for failed tests. BDDX is a web product with browser testing, API access, Gherkin support, and both execution modes. The Start plan is free for up to 50 runs per month. Grow costs $9.99 a month for 51–250 runs, and Accelerate costs $14.99 a month for 251–500 runs. Scale has no listed plan price, with unlimited runs at 0.03$ per run. Email and Jira API token credentials are saved locally on the machine.
Concordion
Concordion is a free, open-source tool for turning written specifications into executable checks and living documentation. Those checks run against the system under test; when they run, Concordion generates documentation that marks passing and failing assertions and shows expected and actual values for failures. The output can include tables and links to other specifications. The project offers Java specifications in Markdown or HTML, along with C# options. Java fixtures use JUnit, and Concordion.NET is documented with NUnit. Integrations include IntelliJ IDEA, Eclipse, Gradle, Maven, command-line execution, Jenkins, and Spring. The IntelliJ plugin supports HTML and Markdown, while Eclipse supports HTML specifications but not Markdown. Extensions can add commands, event listeners, or documentation changes, with examples such as Excel specifications, parallel runs, screenshots, and logging tools. Concordion runs locally on Linux, macOS, and Windows, and is licensed under Apache License 2.0. It is maintained by volunteers.