Airtest Project vs Pretty Good Playtesting

Airtest Project is a UI automation testing suite for games and apps, launched by NetEase Games. Its Airtest framework uses image recognition for cross-platform automated tests; Poco identifies UI controls and can retrieve their hierarchy while an app is running. Airtest supports Windows, Android, and iOS. Poco works with Android and iOS native apps and several game engines, including Unity3D, cocos2dx, UE4, and Egret. A Selenium plugin uses Chrome DevTools Protocol to record and generate scripts and access web elements. AirtestIDE is a cross-platform editor with Airtest and Poco plugins. Scripts are written in Python, and the documentation recommends basic Python knowledge. The free community version includes Airtest, Poco, and AirtestIDE. Airlab adds test case and script management, scheduling, cloud reports, and mobile regression and compatibility testing. Enterprises can choose a private cloud deployment, with price provided after needs are confirmed. Downloads are listed for Windows, macOS, and Ubuntu.

Pretty Good Playtesting is a Windows toolkit for indie game creators coordinating testers and analyzing feedback. Creators share an invite link, filter for a target audience, upload a build, and prepare instructions and a survey. Surveys present one question at a time. Tester management stays in one place, with automatic reminder emails. The product analyzes recordings for trends, creates automatic reports, and highlights moments when players appear confused or stuck. Gameplay recording uses a custom-tuned OBS build, with a stated minimum of a 2015 laptop with integrated graphics. Any game engine is supported, and the product is otherwise compatible with any analytics solution. Privacy and security options include an included or bring-your-own NDA, anonymised tester data, and encrypted builds. The Free tier costs nothing, with specific limits not stated. Hobbyists costs $15 a month and Studios costs $30 a month; both have build and video storage limits and unlimited testers. An event-timestamping API is described as planned, and automatic tester rewards are a future feature.