AWS CodeBuild vs Azure Test Plans
AWS CodeBuild
aws.amazon.com
Azure Test Plans
azure.microsoft.comSide by side
| Figure | AWS CodeBuild | Azure Test Plans |
|---|---|---|
| Price from | $0.01/mo | $6/mo |
| Free plan | Yes | Yes |
| Free trial | — | Yes |
| Open source | — | — |
| Web | Yes | Yes |
| Windows | Yes | Yes |
| macOS | Yes | Yes |
| Linux | Yes | Yes |
| API | Yes | Yes |
| Self-hosted | — | Yes |
| Plans published | 7 | 5 |
| Spec score · Continuous Integration Software | 9.4 (#2) | 9.4 (#3) |
| Spec score · Mobile CI/CD Software | 9.4 (#1) | 9.4 (#2) |
| Spec score · Game Build Automation Software | 9.5 (#2) | 9.4 (#3) |
| Company legal name | Crunchbase lists the maker as Amazon.com, Inc. | The maker is Microsoft Corporation. |
| Purpose | CodeBuild is a fully managed continuous integration service that runs build scripts to compile, test, and package code. | Azure Test Plans provides planned manual and exploratory testing tools for apps. |
| Rating on Capterra | 4.3 out of 5 from 4 reviews | 4.4 out of 5 from 148 reviews |
| Rating on Chrome Web Store | 3.7 out of 5 from 3 ratings | 4.2 out of 5 from 180 ratings |
| Rating on GetApp | 4.3 out of 5 from 4 reviews | 4.4 out of 5 from 147 reviews |
| Rating on TrustRadius | 8 out of 10 from 32 reviews and ratings | 9.1 out of 10 from 10 reviews |
| Security | CodeBuild integrates with AWS IAM for granular access controls, and build artifacts are encrypted with AWS KMS managed keys or customer managed keys. | Azure DevOps states that project data is protected in transit and at rest, uses the Microsoft Security Development Lifecycle and undergoes security penetration testing. |
| What it does | AWS CodeBuild is a fully managed cloud build service that compiles source code, runs unit tests and creates deployable artifacts. | Azure Test Plans lets teams plan, execute and track manual, exploratory and automated testing within Azure DevOps. |
Plans
AWS CodeBuild
- AWS CodeBuild pay-as-you-goFree
- AWS Free Tier (on-demand EC2)Free
- Lambda ARM 1GBFree
- general1.medium$0.01 a month
- general1.small$0.01 a month
- general1.large$0.02 a month
- Reserved x86-64 g1.small$129.60 a month
Azure Test Plans
- Basic + Test Plans$52 a month
- BasicFree
- StakeholdersFree
- Stakeholders (Free)Free
- Basic$6 a month
In their own words
AWS CodeBuild
AWS CodeBuild is a paid, cloud-hosted continuous integration service for compiling, testing, and packaging code from build scripts. It provisions and scales build capacity automatically, so projects do not require users to manage build servers. Preconfigured environments cover Java, Python, Node.js, Ruby, Go, Android, .NET Core for Linux, and Docker; teams can also supply Docker-based environments. A YAML build specification defines commands for each build phase and other settings. Builds can start from CodeCommit, GitHub, GitHub Enterprise, Bitbucket, Amazon S3, or CodePipeline, and can work with Jenkins. Artifacts can be stored in S3 or sent to an artifact repository. IAM provides access controls, while KMS keys encrypt artifacts. Build timing, status, commit ID, metrics, and logs are available through the service and CloudWatch, with SNS event notifications. A free plan provides stated monthly allowances; paid usage starts at 0.01 USD and can add charges for data transfer and related AWS services.
Azure Test Plans
Azure Test Plans gives teams tools to plan, run, and track manual and exploratory testing for apps. For scripted tests, teams can track actionable defects and connect test cases and suites to user stories, features, or requirements. Exploratory sessions let testers design and run tests at the same time. During manual tests, Test Runner can capture screenshots, image action logs, and screen recordings. Reports, dashboard widgets, and customizable Power BI reports show plan progress and trends. The service integrates with Azure Pipelines for CI/CD testing and offers REST APIs and an extension contribution model. Manual testing is available in the web portal through supported browsers on major platforms; a free Test & Feedback extension supports exploratory testing in Chrome and Microsoft Edge. The free Stakeholders plan does not allow users to create or manage Test Plans. Basic is free for the first five users, then $6 per user per month; Basic + Test Plans costs $52 a month, billed at $52 per user per month. A 30-day trial is listed. Azure DevOps cloud-based load testing is deprecated; Microsoft points users to Azure Load Testing for managed load testing.