Codecov vs SimpleCov
Codecov
about.codecov.ioSimpleCov
github.comSide by side
| Figure | Codecov | SimpleCov |
|---|---|---|
| Price from | $5/mo | Free |
| Free plan | Yes | Yes |
| Free trial | Yes | — |
| Open source | Yes | — |
| Web | Yes | Yes |
| Windows | — | Yes |
| macOS | Yes | Yes |
| Linux | Yes | Yes |
| API | Yes | — |
| Self-hosted | Yes | — |
| Plans published | 4 | 1 |
| Spec score · Test Coverage Tools | 9.4 (#1) | 7.4 (#20) |
| Spec score · Code Coverage Tools | 9.3 (#1) | 7.4 (#6) |
| CLI | Codecov CLI can create reports, upload coverage, and access advanced features; it installs with pip or as signed Linux and macOS binaries. | The command line includes report viewing, test selection, patch coverage, history, status, and badge commands. |
| Integrations | Supported code hosts include GitHub, GitHub Enterprise, GitLab, GitLab CE/EE, Bitbucket, and Bitbucket Server. | The README points to open source formatter and integration plugins, editor integrations, and hosted commercial services. |
| License | The gazebo server component uses the Functional Source License 1.1 with an Apache 2.0 license granted after two years, while the Codecov GitHub Action repository is MIT licensed. | The repository identifies SimpleCov as MIT licensed. |
| Purpose | Codecov provides code coverage reporting and insights to help teams improve code quality throughout development. | SimpleCov analyzes Ruby code coverage using Ruby’s built-in Coverage library. |
| Support | The site lists Pro Support and Enterprise Support, and the pricing comparison includes email support among plan features. | The project directs users to its issue tracker for code and bug reports and its Google Groups mailing list for discussion and announcements. |
Plans
In their own words
Codecov
Codecov provides code coverage reporting and development insights, with tools for test analytics, JavaScript bundle monitoring and pull-request checks. It reports line, branch, project and patch coverage in XML, JSON and TXT formats. Pull-request annotations and coverage gates help teams review changes; Status Checks can block a merge when coverage is underperforming. Historical trends show coverage over time. Test Analytics reports failures and detects flaky tests, while Bundle Analysis flags oversized JavaScript bundles in pull requests and tracks bundle-size changes. The homepage also describes AI features for generating unit tests and reviewing pull requests. Developers can use a command-line interface or VS Code extension for coverage information and visualization. Integrations include GitHub, GitLab, Bitbucket, CI platforms and Slack. Codecov lists a broad range of supported languages, including C#, Go, Python, JavaScript, Rust and Swift. It is available through web, API, extension and self-hosted options. The free Developer plan has upload limits for private repositories; paid plans start at $5/user/mo, and a 14-day trial is available.
SimpleCov
SimpleCov is a free, MIT-licensed tool for measuring Ruby code coverage with Ruby’s built-in Coverage library. It produces HTML and JSON reports and can merge results across test suites. Coverage types include line, branch, method, oneshot-line, and eval. Configuration supports filters, groups, profiles, and thresholds. Optional test tracking can show which RSpec examples or Minitest tests cover a line, while oneshot coverage can record code reached in production. The command line includes report viewing, test selection, patch coverage, history, status, and badge commands. A Rails profile can include ERB, Haml, and Slim templates in reports. SimpleCov can also calculate coverage for changed lines and apply a minimum threshold as a gate. The project says it is built in CI on Ruby 3.2+ and JRuby 10+; JRuby supports line coverage only. To track application files, SimpleCov must start before application code is required. The project directs code and bug reports to its issue tracker and discussion and announcements to its Google Groups mailing list.