Test IO vs UserBob
Test IO
test.ioUserBob
userbob.comSide by side
| Figure | Test IO | UserBob |
|---|---|---|
| Price from | — | — |
| Free plan | — | — |
| Free trial | Yes | — |
| Open source | — | — |
| Web | Yes | Yes |
| Windows | Yes | — |
| macOS | Yes | — |
| Linux | Yes | — |
| iOS | Yes | Yes |
| Android | Yes | Yes |
| API | Yes | Yes |
| Plans published | 1 | 10 |
| Spec score · Usability Testing Software | 8.4 (#11) | 7.6 (#29) |
| API | The customer REST API supports operations for products, test environments, exploratory tests, test cases, uploaded app binaries, and bugs, and requires an API token. | UserBob provides a REST API for creating, starting, aborting, and retrieving usability test results. |
| Headquarters | Berlin, Germany | Mustang, Oklahoma, United States |
| Product | Test IO provides crowdtesting services through a SaaS platform and a global community of professional testers. | UserBob recruits people to try an app or website, complete a provided task, and record their screen and spoken feedback. |
Plans
UserBob
- Mobile Web — First Impressions$22.50, paid once
- Web — First Impressions$30, paid once
- Web — Task Completion$37.50, paid once
- Mobile Web — Task Completion$42.50, paid once
- Android App — First Impressions$45, paid once
- iOS App — First Impressions$45, paid once
- Android App — Task Completion$47.50, paid once
- iOS App — Task Completion$47.50, paid once
- Custom — Mobile Web, Android, or iOSPrice not published
- Web — CustomPrice not published
In their own words
Test IO
Test IO provides crowdtesting services to companies through a SaaS platform and a community of professional testers. A customer can submit a mobile app or share a website URL, then schedule a test or start one immediately and review bug reports with screenshots and videos. Testing covers exploratory, functional, regression, accessibility, localization, payment, user story, mobile, and test automation work. Testers evaluate products on real devices, operating systems, and browsers in production-like settings; the service says first results can arrive within an hour. Testers must qualify to join and are continuously evaluated, and they sign non-disclosure agreements with Test IO; customers can also require an agreement. Tests can be started or scheduled through the API, and listed integrations include Jira, Azure DevOps, GitHub, Jenkins, TestRail, and CircleCI, among others. Customers have a dedicated customer success manager reachable by phone, chat, email, or Slack. Test IO is a paid service with custom packages; the pricing note says from €749, and a free tryout is offered without a stated duration.