Skip to content
SPECIFICTION
Get listed

Azure Test Plans vs Harmonia

Azure Test Plans

azure.microsoft.com

Harmonia

github.com

Side by side

FigureAzure Test PlansHarmonia
Price from$6/moFree
Free planYesYes
Free trialYes—
Open source——
WebYes—
WindowsYes—
macOSYes—
LinuxYesYes
APIYes—
Self-hostedYesYes
Plans published51
Spec score · Artifact repository software9.4 (#1)8.0 (#28)
PurposeAzure Test Plans provides planned manual and exploratory testing tools for apps.Harmonia serves a Nix store as a binary cache over HTTP and is written in Rust.
What it doesAzure Test Plans lets teams plan, execute and track manual, exploratory and automated testing within Azure DevOps.Harmonia is a Nix binary cache that serves the /nix/store over HTTP and is written in Rust.

Plans

Azure Test Plans

  • Basic + Test Plans$52 a month
  • BasicFree
  • StakeholdersFree
  • Stakeholders (Free)Free
  • Basic$6 a month

Azure Test Plans pricing →

Harmonia

  • HarmoniaFree

Harmonia pricing →

In their own words

Azure Test Plans

Azure Test Plans gives teams tools to plan, run, and track manual and exploratory testing for apps. For scripted tests, teams can track actionable defects and connect test cases and suites to user stories, features, or requirements. Exploratory sessions let testers design and run tests at the same time. During manual tests, Test Runner can capture screenshots, image action logs, and screen recordings. Reports, dashboard widgets, and customizable Power BI reports show plan progress and trends. The service integrates with Azure Pipelines for CI/CD testing and offers REST APIs and an extension contribution model. Manual testing is available in the web portal through supported browsers on major platforms; a free Test & Feedback extension supports exploratory testing in Chrome and Microsoft Edge. The free Stakeholders plan does not allow users to create or manage Test Plans. Basic is free for the first five users, then $6 per user per month; Basic + Test Plans costs $52 a month, billed at $52 per user per month. A 30-day trial is listed. Azure DevOps cloud-based load testing is deprecated; Microsoft points users to Azure Load Testing for managed load testing.

Visit azure.microsoft.com

Harmonia

Harmonia is free, open-source software for serving a Nix store as a binary cache over HTTP. Written in Rust for Linux self-hosting, it supports HTTP range requests for NAR streaming and streaming build logs. The /serve// endpoint can provide package contents and discover index.html to serve websites directly from the Nix store. Harmonia can transparently compress content with zstd and provide TLS when no frontend web server is used. Documentation covers a NixOS module and nginx HTTPS frontend configuration for a public cache. Narinfo signing is disabled unless private signing-key paths are supplied. Prometheus metrics are available at /metrics, with a Grafana dashboard included in the repository. Since version 3.1.0, metadata is read directly from db.sqlite without a nix-daemon connection. Version 3.3.0 adds harmonia-gc for removing store garbage while nix-daemon builds. It uses the MIT License.

Visit github.com