cargo-llvm-cov vs Coveralls
cargo-llvm-cov
github.comCoveralls
coveralls.ioSide by side
| Figure | cargo-llvm-cov | Coveralls |
|---|---|---|
| Price from | Free | $10/mo |
| Free plan | Yes | Yes |
| Free trial | — | Yes |
| Open source | — | — |
| Web | — | Yes |
| Windows | Yes | — |
| macOS | Yes | — |
| Linux | Yes | Yes |
| API | — | Yes |
| Self-hosted | — | Yes |
| Plans published | 1 | 10 |
| Spec score · Test Coverage Tools | 8.1 (#8) | 8.6 (#3) |
| Purpose | cargo-llvm-cov is a Cargo subcommand that wraps rustc’s LLVM source-based code coverage instrumentation. | Coveralls analyzes test coverage to show which parts of code are not covered by tests. |
Plans
Coveralls
- Open SourceFree
- Starter$10 a month
- Usage add-on$30 a month
- Enterprise Cloud$35 a month
- Org$50 a month
- Org+$100 a month
- Pro$200 a month
- Support add-on$200 a month
- Unlimited$400 a month
- Cloud Premium$800 a month
In their own words
cargo-llvm-cov
cargo-llvm-cov is a Cargo subcommand that uses rustc’s LLVM source-based instrumentation to generate code coverage reports. It works with cargo test, cargo run, and cargo nextest through a Cargo-compatible command-line interface, and supports proc-macro UI tests. Line and region coverage are available; branch coverage is optional and requires nightly Rust. Doc-test coverage is also optional and requires nightly features. Reports can be generated as text, HTML, JSON, LCOV, Cobertura XML, or Codecov Custom Coverage format. The project provides GitHub Actions examples for uploading reports to Codecov and a GitLab CI example using Cobertura output. LCOV results can be viewed in VS Code with the Coverage Gutters extension. With compatible Clang and LLVM tools configured, the tool can include C and C++ code linked to a Rust library or binary. It supports Linux, macOS, and Windows, and is licensed under either Apache-2.0 or MIT at the user's choice. Installation requires rustc 1.87 or newer, while running it requires Cargo 1.60 or newer. Branch and doc-test coverage are unstable and have known issues, respectively.
Coveralls
Coveralls analyzes software test coverage, showing teams which code is not covered by tests. Its dashboard presents project coverage percentages and their changes over time, while repository views drill down from a project to sub-projects, files, and individual lines. Build history tracks coverage across branches, including pull requests. Coveralls can add summarized coverage results to pull requests and send status updates that apply coverage criteria to merge decisions. Notifications can go to Slack or webhooks. It supports line and branch coverage, with report formats including LCOV, SimpleCov, Cobertura, JaCoCo, and Clover XML. Coveralls says it works with any CI service and lists more than 30 community-created integrations, a GitHub Action, and a CircleCI Orb. An API can add repositories programmatically and return recent build statistics. Open-source and public repositories are free. The Starter plan is $10 a month for one private repository and includes a 30-day trial. A self-hosted enterprise installation can operate within existing security controls without outbound network access.