AWS Device Farm vs TestingBot
AWS Device Farm
aws.amazon.com
TestingBot
testingbot.comSide by side
| Figure | AWS Device Farm | TestingBot |
|---|---|---|
| Price from | $200/mo | $20/mo |
| Free plan | — | — |
| Free trial | Yes | Yes |
| Open source | — | — |
| Web | Yes | Yes |
| Windows | — | Yes |
| macOS | — | Yes |
| Linux | — | Yes |
| iOS | Yes | Yes |
| Android | Yes | Yes |
| API | Yes | Yes |
| Plans published | 4 | 8 |
| Spec score · Device Farm Software | 8.4 (#5) | 8.5 (#4) |
| Spec score · Mobile App Testing Software | 8.4 (#12) | 8.5 (#11) |
| Spec score · Mobile Device Testing Software | 8.3 (#7) | 8.5 (#4) |
| Spec score · Browser Testing Software | 8.4 (#15) | 8.5 (#12) |
| Browser coverage | Desktop browser testing supports multiple browser versions, including Chrome and Firefox. | The platform lists Internet Explorer 8 through 11, Edge, Chrome, Safari, Firefox and Opera across real operating systems. |
| Founded | 2006 | TestingBot says it was founded in 2011 to simplify Selenium testing; LinkedIn lists 2012 as the founded year. |
| Integrations | Service plugins and an API can initiate tests and retrieve results from IDEs and continuous integration environments such as Android Studio and Jenkins. | Official integrations include Slack, Jira, GitHub and CI/CD systems such as GitHub Actions, Jenkins, CircleCI, GitLab CI, Bitbucket Pipelines, Travis CI, TeamCity and Azure DevOps. |
| Security | Device Farm requires TLS 1.2 and recommends TLS 1.3 for network access through its published APIs. | TestingBot states that each test uses a single-use machine and wiped device, with infrastructure in European data centers and GDPR and CSA STAR claims. |
Plans
AWS Device Farm
- Desktop browser testing$0.01, paid once
- Real mobile devices — pay as you go$0.17, paid once
- Private devices$200 a month
- Unlimited test and access$250 a month
TestingBot
- Live€20 a year
- Live$20 a month
- Automated€50 a year
- Automated$50 a month
- Pay As You Go€60, paid once
- Automated Pro$90 a month
- Automated Pro€90 a year
- EnterprisePriced on request
In their own words
AWS Device Farm
AWS Device Farm has no write-up on Specifiction yet; its figures are above.
TestingBot
TestingBot provides a cloud testing grid for automated and manual testing on real browsers and physical mobile devices. Its options include live manual, visual, automated, and AI-assisted testing, with support stated for Selenium, Appium, Playwright, Cypress, Puppeteer, Espresso, XCUITest, and Maestro. Automated tests can run in parallel, with concurrency controlled through test configuration or a CI pipeline. Listed integrations include Jenkins, GitHub Actions, GitLab CI, CircleCI, Azure DevOps, Bamboo, TeamCity, Travis CI, Jira, and Slack. A public REST API and webhooks support custom integrations. TestingBot lists a free plan and a 14-day trial. Live costs €20 a year, billed annually, or €30 month-to-month; Automated costs €50 a year, billed annually, or €70 month-to-month. Pay As You Go costs €60, paid once payment, and Automated Pro costs €90 a year, billed annually, or €120 month-to-month. Enterprise pricing is by contact. TestingBot says sessions use isolated machines or devices wiped after testing, with test artifacts stored and processed in EU datacenters.