Roborazzi vs SmartUI
Roborazzi
github.com
SmartUI
testmuai.comSide by side
| Figure | Roborazzi | SmartUI |
|---|---|---|
| Price from | Free | $199/mo |
| Free plan | Yes | Yes |
| Free trial | — | — |
| Open source | — | — |
| Web | — | Yes |
| Windows | Yes | — |
| macOS | Yes | — |
| Linux | Yes | — |
| iOS | Yes | Yes |
| Android | Yes | Yes |
| API | — | Yes |
| Plans published | 1 | 3 |
| Spec score · Visual Regression Testing Software | 8.5 (#5) | 8.0 (#12) |
| Integrations | Roborazzi is available on Maven Central and provides Gradle tasks for recording, comparing, and verifying screenshots. | The product page says SmartUI can export diffs and fix suggestions to Jira or Slack and shows integrations including GitHub and GitLab. |
| Purpose | Roborazzi is an open-source library for making JVM Android integration tests visible through screenshot testing. | SmartUI captures and compares application UI screenshots against baselines to identify visual regressions across browsers, devices, apps, and PDFs. |
| Security | The AI assertion documentation advises passing API keys through environment variables rather than hard-coding them in code. | TestMu AI states its platform is SOC 2 Type 2 compliant and GDPR and CCPA compliant; it says test virtual machines are reset and user data is wiped after sessions. |
Plans
In their own words
Roborazzi
Roborazzi is an open-source library for screenshot testing in JVM-based Android integration tests. It records images, compares them with saved baselines and can fail verification when a screenshot differs. Through Robolectric, Android tests can run as JVM tests without a device or emulator. Capture options include Jetpack Compose nodes, Espresso views, Android Views and Compose lambdas; the library can also create screenshot tests for Compose previews and common Compose Multiplatform previews. It supports Compose Desktop and JVM preview tests, rendering images with the host’s Skia, while Compose Multiplatform iOS support is experimental. Gradle tasks cover recording, comparison and verification, and the project documents GitHub Actions workflows for screenshot checks in CI. An IDE plugin shows test screenshots in IntelliJ IDEA and Android Studio. Optional capabilities include UI-tree JSON output, accessibility checks, animated GIF or APNG capture, and experimental AI image assertions. Roborazzi is free, available on Maven Central and licensed under Apache License 2.0. It has no direct Bazel support, and graphics may render differently across operating systems.
SmartUI
SmartUI captures application UI screenshots and compares them with baselines to identify visual regressions across browsers, devices, apps, and PDFs. Its Visual AI filters rendering noise and explains meaningful differences, while Smart Ignore can mask dynamic regions and distinguish layout shifts from other changes. Root Cause Analysis compares screenshot differences with code changes and suggests fixes. The listed frameworks include Selenium, Playwright, Puppeteer, Cypress, Appium, Espresso, XCUITest, and Jest. SmartUI describes coverage across 3,000+ browser combinations and 10,000+ real devices, and supports Figma-to-live-UI comparison and PDF checks for text, layout, font, and graphic differences. Git branch-aware baselines work across branches and CI/CD pipelines; diffs and suggestions can be exported to Jira or Slack, with GitHub and GitLab integrations listed. The free plan includes 2,000 screenshots for lifetime use and one month of build history. SmartUI Visual Regression costs $199 a month, billed annually, and includes one year of build history; screenshot volume is selected with the plan.