aqua vs Azure Test Plans
aqua
aqua-cloud.io
Azure Test Plans
azure.microsoft.comSide by side
| Figure | aqua | Azure Test Plans |
|---|---|---|
| Price from | €19/mo | $6/mo |
| Free plan | Yes | Yes |
| Free trial | Yes | Yes |
| Open source | — | — |
| Web | Yes | Yes |
| Windows | Yes | Yes |
| macOS | — | Yes |
| Linux | Yes | Yes |
| API | Yes | Yes |
| Self-hosted | Yes | Yes |
| Plans published | 14 | 5 |
| Spec score · Quality Assurance Software | 9.5 (#1) | 9.5 (#2) |
| Spec score · Qa Platforms | 9.5 (#1) | 9.4 (#2) |
| Spec score · Manual Testing Tools | 9.5 (#1) | 9.5 (#2) |
| API | The REST API can create and modify items, users and test runs and submit automated results. | Public REST endpoints use dev.azure.com organization URLs and versioned _apis paths; the Test Plans API includes plan listing and requires the vso.test scope for read access. |
| Documentation | The documentation site contains more than 600 pages covering product use, integrations, automation and installation. | Microsoft publishes reference, conceptual and how-to documentation covering manual runs, configurations, UAT, diagnostics, exploratory sessions and stakeholder feedback. |
| Integrations | Documented integrations include Jira, Confluence, Azure DevOps, Jenkins, Selenium, JMeter, Ranorex, SoapUI and other testing tools. | Azure DevOps exposes integrations with GitHub, Docker, Slack, Sentry and more through its Marketplace extension ecosystem. |
| Rating on Capterra | 4.7 out of 5 from 28 reviews | 4.4 out of 5 from 148 reviews |
| Rating on GetApp | 4.7 out of 5 from 28 reviews | 4.4 out of 5 from 147 reviews |
| Rating on TrustRadius | 8 out of 10 from 2 reviews | 9.1 out of 10 from 10 reviews |
| Reporting | Dashboards, KPI alerts and a Report Wizard provide charts, external data and media for QA reporting. | The product includes configurable test charts, progress reports, a Test Runs hub, dashboard widgets and Analytics-based reporting. |
| Security | The maker states that aqua is ISO 27001 certified and GDPR compliant, and describes it as DORA ready. | Azure DevOps states that project data is protected in transit and at rest, uses the Microsoft Security Development Lifecycle and undergoes security penetration testing. |
Plans
aqua
- GuestFree
- Test Runner DEV — Full TR license, billed annually€19 a month
- Test Runner DEV€29 a month
- Test Runner DEV — Full TR license, billed monthly€29 a month
- Requirement Management — Full RM license, billed annually€89 a month
- aqua Suite€99 a month
- aqua Suite LicensePriced on request
- Requirement Management€119 a month
- Requirement Management — Full RM license, billed monthly€119 a month
- Test Management€119 a month
Azure Test Plans
- Basic + Test Plans$52 a month
- BasicFree
- StakeholdersFree
- Stakeholders (Free)Free
- Basic$6 a month
In their own words
aqua
aqua is a test management tool for quality assurance, software testing, and workflow management. It supports manual and automated testing in one platform, with a requirements view to identify requirements not covered by tests. Its AI can generate requirements, test cases, and test data from user input. Integrations include Jira, Confluence, Jenkins, Ranorex, UFT, Selenium, JMeter, SoapUI, MSSQL, Oracle, PowerShell, and UnixShell, alongside a REST API. Deployment is available through cloud or on-premise options. aqua supports LDAP authentication, Single Sign-On, and permissions that can control more than 100 actions. The maker states that it is ISO 27001 certified, GDPR compliant, and DORA ready; subscriptions include continuous support. The FAQ says there is no dedicated mobile app. Guest access is free with unlimited seats and read-only access. Test Runner DEV costs €19.00 per month billed annually or €29.00 per month billed monthly. The maker advertises a 30-day trial.
Azure Test Plans
Azure Test Plans gives teams tools to plan, run, and track manual and exploratory testing for apps. For scripted tests, teams can track actionable defects and connect test cases and suites to user stories, features, or requirements. Exploratory sessions let testers design and run tests at the same time. During manual tests, Test Runner can capture screenshots, image action logs, and screen recordings. Reports, dashboard widgets, and customizable Power BI reports show plan progress and trends. The service integrates with Azure Pipelines for CI/CD testing and offers REST APIs and an extension contribution model. Manual testing is available in the web portal through supported browsers on major platforms; a free Test & Feedback extension supports exploratory testing in Chrome and Microsoft Edge. The free Stakeholders plan does not allow users to create or manage Test Plans. Basic is free for the first five users, then $6 per user per month; Basic + Test Plans costs $52 a month, billed at $52 per user per month. A 30-day trial is listed. Azure DevOps cloud-based load testing is deprecated; Microsoft points users to Azure Load Testing for managed load testing.