cargo-llvm-cov vs Codecov
cargo-llvm-cov
github.com
Codecov
about.codecov.ioSide by side
| Figure | cargo-llvm-cov | Codecov |
|---|---|---|
| Price from | Free | $5/mo |
| Free plan | Yes | Yes |
| Free trial | — | Yes |
| Open source | — | Yes |
| Web | — | Yes |
| Windows | Yes | — |
| macOS | Yes | Yes |
| Linux | Yes | Yes |
| API | — | Yes |
| Self-hosted | — | Yes |
| Plans published | 1 | 4 |
| Spec score · Test Coverage Tools | 8.1 (#8) | 9.4 (#1) |
| CI integrations | The README provides GitHub Actions examples for uploading reports to Codecov and a GitLab CI example using Cobertura output. | Listed CI integrations include GitHub Actions, GitLab CI, Jenkins, Azure Pipelines, CircleCI, Buildkite, TeamCity, Travis CI, and others. |
| License | The project is available under either the Apache License 2.0 or the MIT License, at the user's option. | The gazebo server component uses the Functional Source License 1.1 with an Apache 2.0 license granted after two years, while the Codecov GitHub Action repository is MIT licensed. |
| Purpose | cargo-llvm-cov is a Cargo subcommand that wraps rustc’s LLVM source-based code coverage instrumentation. | Codecov provides code coverage reporting and insights to help teams improve code quality throughout development. |
Plans
In their own words
cargo-llvm-cov
cargo-llvm-cov is a Cargo subcommand that uses rustc’s LLVM source-based instrumentation to generate code coverage reports. It works with cargo test, cargo run, and cargo nextest through a Cargo-compatible command-line interface, and supports proc-macro UI tests. Line and region coverage are available; branch coverage is optional and requires nightly Rust. Doc-test coverage is also optional and requires nightly features. Reports can be generated as text, HTML, JSON, LCOV, Cobertura XML, or Codecov Custom Coverage format. The project provides GitHub Actions examples for uploading reports to Codecov and a GitLab CI example using Cobertura output. LCOV results can be viewed in VS Code with the Coverage Gutters extension. With compatible Clang and LLVM tools configured, the tool can include C and C++ code linked to a Rust library or binary. It supports Linux, macOS, and Windows, and is licensed under either Apache-2.0 or MIT at the user's choice. Installation requires rustc 1.87 or newer, while running it requires Cargo 1.60 or newer. Branch and doc-test coverage are unstable and have known issues, respectively.
Codecov
Codecov provides code coverage reporting and development insights, with tools for test analytics, JavaScript bundle monitoring and pull-request checks. It reports line, branch, project and patch coverage in XML, JSON and TXT formats. Pull-request annotations and coverage gates help teams review changes; Status Checks can block a merge when coverage is underperforming. Historical trends show coverage over time. Test Analytics reports failures and detects flaky tests, while Bundle Analysis flags oversized JavaScript bundles in pull requests and tracks bundle-size changes. The homepage also describes AI features for generating unit tests and reviewing pull requests. Developers can use a command-line interface or VS Code extension for coverage information and visualization. Integrations include GitHub, GitLab, Bitbucket, CI platforms and Slack. Codecov lists a broad range of supported languages, including C#, Go, Python, JavaScript, Rust and Swift. It is available through web, API, extension and self-hosted options. The free Developer plan has upload limits for private repositories; paid plans start at $5/user/mo, and a 14-day trial is available.