Azure Test Plans vs TeamCity
Azure Test Plans
azure.microsoft.com
TeamCity
jetbrains.comSide by side
| Figure | Azure Test Plans | TeamCity |
|---|---|---|
| Price from | $6/mo | $15/mo |
| Free plan | Yes | Yes |
| Free trial | Yes | Yes |
| Open source | — | — |
| Web | Yes | Yes |
| Windows | Yes | Yes |
| macOS | Yes | Yes |
| Linux | Yes | Yes |
| Android | — | Yes |
| API | Yes | Yes |
| Self-hosted | Yes | Yes |
| Plans published | 5 | 8 |
| Spec score · Continuous Integration Software | 9.4 (#3) | 8.7 (#7) |
| Spec score · Game Build Automation Software | 9.4 (#3) | 8.7 (#8) |
| Spec score · Ci Cd Platforms | 9.4 (#2) | 8.7 (#5) |
| Spec score · Mobile CI/CD Software | 9.4 (#2) | 8.8 (#5) |
| Company legal name | The maker is Microsoft Corporation. | The TeamCity licence identifies the maker as JetBrains s.r.o., registered in Prague, Czech Republic. |
| Compliance | Azure DevOps lists ISO 27001:2022, ISO 27018:2019, ISO 26262:2023, HIPAA, BAA, EU Model Clauses, SOC 1 Type 2 and SOC 2 Type 2 among its certifications or commitments. | TeamCity's security page states that it is SOC 2 Type II and GDPR compliant. |
| Founded | Microsoft was founded in 1975. | 2000 |
| Integrations | Azure DevOps exposes integrations with GitHub, Docker, Slack, Sentry and more through its Marketplace extension ecosystem. | Built-in integrations use UI controls or specialized REST endpoints, and additional plugins can extend coverage. |
| Purpose | Azure Test Plans provides planned manual and exploratory testing tools for apps. | TeamCity is a continuous integration and delivery server for automating builds, tests, and software delivery. |
| Rating on Capterra | 4.4 out of 5 from 148 reviews | TeamCity is rated 4.5 out of 5 from 51 reviews on Capterra. |
| Rating on Gartner Peer Insights | 4.3 out of 5 from 197 ratings | Gartner Peer Insights shows 4.5 out of 5 from 22 ratings. |
| Rating on GetApp | 4.4 out of 5 from 147 reviews | GetApp lists TeamCity at 4.6 out of 5 from 50 reviews. |
| Rating on Trustpilot | 1.5 out of 5 from 60 reviews | The JetBrains company profile on Trustpilot is rated 2.6 out of 5 from 102 reviews. |
| Self-hosting | The same test-management documentation covers Azure DevOps Services and Azure DevOps Server, including Server 2022. | On-Premises lets customers install and administer the TeamCity server and agents on their own infrastructure. |
| What it does | Azure Test Plans lets teams plan, execute and track manual, exploratory and automated testing within Azure DevOps. | TeamCity is JetBrains’ continuous integration and continuous delivery server for automating builds, tests and deployments. |
Plans
Azure Test Plans
- Basic + Test Plans$52 a month
- BasicFree
- StakeholdersFree
- Stakeholders (Free)Free
- Basic$6 a month
TeamCity
- Professional (On-Premises)Free
- Cloud$15 a month
- TeamCity Cloud$15 a month
- Additional build credits$20, paid once
- Additional Cloud build credits$20, paid once
- Additional build agent$359 a year
- Additional On-Premises build agent$359 a year
- Enterprise (On-Premises)$2,399 a year
In their own words
Azure Test Plans
Azure Test Plans gives teams tools to plan, run, and track manual and exploratory testing for apps. For scripted tests, teams can track actionable defects and connect test cases and suites to user stories, features, or requirements. Exploratory sessions let testers design and run tests at the same time. During manual tests, Test Runner can capture screenshots, image action logs, and screen recordings. Reports, dashboard widgets, and customizable Power BI reports show plan progress and trends. The service integrates with Azure Pipelines for CI/CD testing and offers REST APIs and an extension contribution model. Manual testing is available in the web portal through supported browsers on major platforms; a free Test & Feedback extension supports exploratory testing in Chrome and Microsoft Edge. The free Stakeholders plan does not allow users to create or manage Test Plans. Basic is free for the first five users, then $6 per user per month; Basic + Test Plans costs $52 a month, billed at $52 per user per month. A 30-day trial is listed. Azure DevOps cloud-based load testing is deprecated; Microsoft points users to Azure Load Testing for managed load testing.
TeamCity
TeamCity is a continuous integration and delivery server for automating software builds, tests and delivery. Build chains organize pipelines into reusable steps that can run in parallel and share results across configurations. Build caching, artifact dependencies and incremental builds reduce repeated work. TeamCity can test changes before commit and commit them automatically if they pass, while test-history analysis can flag inconsistent results. Pipeline settings can be kept in Kotlin DSL, XML or YAML, or generated from the interface. Supported version control systems include Git, Perforce, Mercurial, Subversion and CVS, with integrations for GitHub, GitLab, Bitbucket and Azure DevOps. Listed infrastructure integrations include AWS, Kubernetes, Google Cloud Platform, Azure Resource Manager and VMware vSphere. TeamCity is available on-premises or in the cloud. The Professional on-premises plan is free forever and includes three build agents, 100 build configurations and 10 pipelines. Cloud costs $15.00 per committer, per month, with a three-committer minimum; its trial is 14 days, while the on-premises Enterprise trial lasts 30 days.