Webcam Motion Capture vs XR Animator

Webcam Motion Capture uses a computer or smartphone camera to drive a 3D avatar, with tracking for hands and fingers, head and upper body, facial expressions, eye gaze, blinking, and lip sync. It can send tracking data to VMC-compatible apps, including VSeeFace and game engines using plugins, and can save motion data as FBX for use in Blender, Maya, and 3ds Max. The maker describes pairing it with OBS Studio to record or stream avatar video. It can also receive mocopi motion data and combine it with hand and face tracking. The FAQ lists Windows 10 or later and macOS Catalina or later; the listed platforms are iOS, macOS, and Windows. A free plan is available, but hiding the interface, sending tracking data to external apps, and saving FBX files require a subscription. The maker permits commercial content creation and monetization, while prohibiting resale or redistribution of the app.

XR Animator is a free tool for driving MMD or VRM 3D avatars from pose input. It uses MediaPipe and TensorFlow.js to detect poses from webcam video, and supports face, full-body, and combined face, body, and hand tracking. Full-body tracking can use a webcam or an image or video file. Face tracking supports 52 ARKit-compatible blendshapes. Users can record motion capture, export VMD, BVH, and glTF motion, and load VMD, FBX, and BVH motion files; FBX or BVH motion can also be exported to VMD. The scene can include 2D images or video, 3D panoramas, and .x or .glb objects. The web app works in major desktop and smartphone browsers, while Electron apps are available for Windows, Linux, and macOS. Android Chrome supports augmented reality. VMC protocol support and a frameless transparent background for capture apps are limited to Electron mode. The project notes that smartphones with limited processing power may be better suited to face tracking alone.