Airtest Project vs GameBench
Airtest Project
airtest.netease.com
GameBench
gamebench.netSide by side
| Figure | Airtest Project | GameBench |
|---|---|---|
| Price from | Free | Free |
| Free plan | Yes | Yes |
| Free trial | — | Yes |
| Open source | — | — |
| Web | Yes | Yes |
| Windows | Yes | Yes |
| macOS | Yes | Yes |
| Linux | Yes | Yes |
| iOS | Yes | Yes |
| Android | Yes | Yes |
| API | — | Yes |
| Self-hosted | Yes | Yes |
| Plans published | 2 | 3 |
| Spec score · Game Testing Software | 8.4 (#6) | 8.8 (#3) |
| Audience | The private cloud solution is aimed at enterprises seeking device clusters, device management, test execution, reporting, and continuous integration. | GameBench services target game publishers, network operators, and technology providers. |
| Integrations | Poco can be integrated into other engines using poco-sdk. | The dashboard documentation includes Jira integration and SSO configuration areas. |
| Purpose | AirtestProject is a UI automation testing solution launched by NetEase Games for games and apps. | GameBench provides tools for measuring, analyzing, and optimizing game performance. |
| Support | The project offers documentation, official Q&A groups, issue submission links, and an official website question channel. | Enterprise deployment support is available through [email protected]. |
Plans
Airtest Project
- Airtest Project community versionFree
- NetEase Private Cloud SolutionPriced on request
GameBench
- GameBench FPS MonitorFree
- GameBench Pro trialFree
- Enterprise licensePriced on request
In their own words
Airtest Project
Airtest Project is a UI automation testing suite for games and apps, launched by NetEase Games. Its Airtest framework uses image recognition for cross-platform automated tests; Poco identifies UI controls and can retrieve their hierarchy while an app is running. Airtest supports Windows, Android, and iOS. Poco works with Android and iOS native apps and several game engines, including Unity3D, cocos2dx, UE4, and Egret. A Selenium plugin uses Chrome DevTools Protocol to record and generate scripts and access web elements. AirtestIDE is a cross-platform editor with Airtest and Poco plugins. Scripts are written in Python, and the documentation recommends basic Python knowledge. The free community version includes Airtest, Poco, and AirtestIDE. Airlab adds test case and script management, scheduling, cloud reports, and mobile regression and compatibility testing. Enterprises can choose a private cloud deployment, with price provided after needs are confirmed. Downloads are listed for Windows, macOS, and Ubuntu.
GameBench
GameBench provides tools for measuring, analyzing and optimizing game performance. With GameBench Pro, users connect an Android or iOS device, choose a game, measure its performance and upload results to a dashboard. GameBench Injector adds instrumentation to APK or IPA builds without requiring developer code changes. Metrics include frame rate, CPU, GPU, memory, power, battery, network usage, screenshots and thermal throttling. The web dashboard stores and visualizes sessions, trends, apps, devices and collections for comparison. Its API supports token creation, session searches, session details and time-series metrics; Jira integration can create engineering tickets linked to sessions. Dashboard accounts support SSO and LDAP, and companies can require multi-factor authentication. Enterprise customers can run a private dashboard on their own infrastructure. The native SDK supports Android 5.0+, 64-bit iOS 10.0+ and tvOS 10.0+, for hardware platforms only. Pricing is on request, and a 28-day trial is listed. The trial includes 30 minutes of Pro testing, unlimited sessions and SDK sessions, full API access, and all metrics and analytics.