DeepMotion Animate 3D vs XR Animator

DeepMotion Animate 3D turns video into 3D animation using markerless AI motion capture. It tracks body movement, facial expressions and hand gestures, including multiple subjects—up to eight people in a single video. Users can choose default characters, upload FBX, GLB or VRM characters, or create avatars with Ready Player Me and Avaturn. Tools include physics simulation, foot locking, hand-to-ground contact, motion smoothing and a Rotoscope Pose Editor. The service accepts MP4, MOV and AVI video; exports include FBX, BVH, MP4 and GLB, with GLB export available for custom characters. One credit covers one second of animation or one 3D pose; face and hand tracking each add 0.5 credit per second or pose. Monthly credits reset without carrying forward. The free account is for personal, non-commercial use; licensed animation requires a premium subscription. The maker says uploaded videos are private to the account holder. An API and real-time SDK are available, with pricing by contacting sales.

XR Animator is a free tool for driving MMD or VRM 3D avatars from pose input. It uses MediaPipe and TensorFlow.js to detect poses from webcam video, and supports face, full-body, and combined face, body, and hand tracking. Full-body tracking can use a webcam or an image or video file. Face tracking supports 52 ARKit-compatible blendshapes. Users can record motion capture, export VMD, BVH, and glTF motion, and load VMD, FBX, and BVH motion files; FBX or BVH motion can also be exported to VMD. The scene can include 2D images or video, 3D panoramas, and .x or .glb objects. The web app works in major desktop and smartphone browsers, while Electron apps are available for Windows, Linux, and macOS. Android Chrome supports augmented reality. VMC protocol support and a frameless transparent background for capture apps are limited to Electron mode. The project notes that smartphones with limited processing power may be better suited to face tracking alone.