Azure Test Plans vs QuickBuild
Azure Test Plans
azure.microsoft.comQuickBuild
pmease.comSide by side
| Figure | Azure Test Plans | QuickBuild |
|---|---|---|
| Price from | $6/mo | $200/mo |
| Free plan | Yes | Yes |
| Free trial | Yes | Yes |
| Open source | — | — |
| Web | Yes | Yes |
| Windows | Yes | Yes |
| macOS | Yes | Yes |
| Linux | Yes | Yes |
| API | Yes | Yes |
| Self-hosted | Yes | Yes |
| Plans published | 5 | 4 |
| Spec score · Continuous Integration Software | 9.4 (#3) | 8.0 (#26) |
| Extensibility | Azure DevOps extensions can add hubs and test experiences through REST APIs and the VSS Web Extension SDK. | Custom plugins can add SCM systems, issue trackers, build steps, reports, statistics, notifiers, and authentication systems; external systems can use its RESTful API. |
| Integrations | Azure DevOps exposes integrations with GitHub, Docker, Slack, Sentry and more through its Marketplace extension ecosystem. | The product lists SCM support including Git, Subversion, Perforce, Mercurial, and Team Foundation Server, and issue tracker support including JIRA, Trac, Bugzilla, TeamForge, and Redmine. |
| Purpose | Azure Test Plans provides planned manual and exploratory testing tools for apps. | QuickBuild is a flexible continuous integration and deployment server for DevOps teams. |
| Security | Azure DevOps states that project data is protected in transit and at rest, uses the Microsoft Security Development Lifecycle and undergoes security penetration testing. | Listed access controls include SSL, IP address binding, role-based and per-project access, LDAP and Active Directory integration, single sign-on, and user activity auditing. |
Plans
Azure Test Plans
- Basic + Test Plans$52 a month
- BasicFree
- StakeholdersFree
- Stakeholders (Free)Free
- Basic$6 a month
QuickBuild
- Community LicenseFree
- Open Source LicenseFree
- Commercial Service renewal$2,400 a year
- Enterprise Site License$3,600, paid once
In their own words
Azure Test Plans
Azure Test Plans gives teams tools to plan, run, and track manual and exploratory testing for apps. For scripted tests, teams can track actionable defects and connect test cases and suites to user stories, features, or requirements. Exploratory sessions let testers design and run tests at the same time. During manual tests, Test Runner can capture screenshots, image action logs, and screen recordings. Reports, dashboard widgets, and customizable Power BI reports show plan progress and trends. The service integrates with Azure Pipelines for CI/CD testing and offers REST APIs and an extension contribution model. Manual testing is available in the web portal through supported browsers on major platforms; a free Test & Feedback extension supports exploratory testing in Chrome and Microsoft Edge. The free Stakeholders plan does not allow users to create or manage Test Plans. Basic is free for the first five users, then $6 per user per month; Basic + Test Plans costs $52 a month, billed at $52 per user per month. A 30-day trial is listed. Azure DevOps cloud-based load testing is deprecated; Microsoft points users to Azure Load Testing for managed load testing.
QuickBuild
QuickBuild is a continuous integration and deployment server for DevOps teams. Builds can start after commits, on schedules, or when dependencies finish, with progress and logs reported in real time. Visual drag-and-drop workflow design supports reuse across projects through inheritance and variables. Pipelines can promote builds, track deployments, and roll back to a previous deployment. Its build grid scales across nodes and can launch on-demand nodes in AWS, Azure, and Kubernetes environments. QuickBuild lists source-control support for Git, Subversion, Perforce, Mercurial, and Team Foundation Server, plus issue trackers including JIRA, Trac, Bugzilla, TeamForge, and Redmine. Test reporting covers JUnit and NUnit, with inspection and coverage reporting for tools including Checkstyle, FindBugs, PMD, and Cobertura. Access controls include role- and project-based permissions, LDAP and Active Directory integration, single sign-on, SSL, IP binding, and activity auditing. It is available for web, Windows, Linux, macOS, and self-hosted deployment, with an API. The Community License is free for up to 16 configurations; the qualifying Open Source License is free with unlimited configurations. The Enterprise Site License costs $3,600 as a one-time purchase per physical site, including one year of commercial service.