Coverage.py vs Tarpaulin
Coverage.py
coverage.readthedocs.ioTarpaulin
github.comSide by side
| Figure | Coverage.py | Tarpaulin |
|---|---|---|
| Price from | Free | — |
| Free plan | Yes | — |
| Free trial | — | — |
| Open source | Yes | — |
| Windows | Yes | Yes |
| macOS | Yes | Yes |
| Linux | Yes | Yes |
| API | Yes | — |
| Self-hosted | Yes | Yes |
| Plans published | 2 | 0 |
| Spec score · Test Coverage Tools | 8.9 (#2) | 6.9 (#24) |
| Branch coverage | The tool can measure whether alternative branch paths were executed. | The CLI help labels branch coverage as not implemented. |
| Installation | The documented installation command is `python3 -m pip install coverage`. | Tarpaulin is a command-line program installed with Cargo, and the README also mentions Nix and cargo-binstall installation options. |
| License | Coverage.py is licensed under the Apache 2.0 License. | Tarpaulin is licensed under both MIT and Apache License 2.0. |
| Purpose | Coverage.py measures which parts of Python programs ran and identifies executable code that did not run, commonly to gauge test effectiveness. | Tarpaulin is a code coverage reporting tool for Rust projects using the Cargo build system. |
| Reports | It can produce text, HTML, XML, LCOV, and JSON reports. | Tarpaulin can generate HTML, JSON, stdout, XML, and LCOV coverage reports. |
| Security | The project directs vulnerability reports to Tidelift, which it says will coordinate the fix and disclosure. | The Docker instructions use seccomp=unconfined and also describe adjusting the seccomp policy to allow the personality syscall. |
| Support | Users can seek help on the Python discussion forums or Python Discord, report bugs on GitHub, and obtain professional support through Tidelift Subscription. | The README welcomes issues, feature requests, and pull requests, and points users to troubleshooting guidance. |
Plans
In their own words
Coverage.py
Coverage.py measures which parts of Python programs run and highlights executable code that remains untouched, helping developers assess what their tests exercise. It measures statement coverage by default and can also track branch coverage. Reports are available as text, HTML, XML, LCOV, and JSON. Dynamic contexts can associate lines of execution with the test function that ran them. Coverage.py can run test suites through their usual command; pytest-cov is available but the documentation says most users do not need it. Third-party plugins can extend measurement to non-Python files, such as connecting executed Python to Django templates. Data is stored in a SQLite database, and advanced use can rely on its API. The current documentation lists Python 3.10 through 3.15 rc2 and PyPy3 versions 3.10 and 3.11. The tool provides ctrace, pytrace, and sysmon measurement cores; sysmon is faster for simple line and branch coverage but lacks support for dynamic contexts and plugins. Coverage.py is licensed under Apache 2.0 and runs on Linux, macOS, and Windows, with self-hosting available. It is free.