nizima LIVE vs XR Animator

nizima LIVE tracks facial expression and movement to animate Live2D models for VTubing, video calls, and other uses. Its output does not show the user's real camera image, according to the maker. Users can tune tracking parameters, set audio-based lip sync, and map tracking items to model parameters. Camera tracking needs a separate webcam or iPhone; connecting the nizima LIVE TRACKER iPhone app can provide higher-precision tracking than a webcam, according to the maker. The app has over 100 preset items and can load items bought on nizima or created by users. Collaboration rooms allow up to eight people, and a paid user's presence removes free users' time limits. The maker offers a free OBS Studio plugin, but streaming also needs separate software such as OBS Studio. Sony mocopi can supply leg and waist movement when paired with mocopi hardware and a compatible Live2D model. A free nizima account is required. The free plan costs ¥0 and allows 40 minutes of continuous camera use, displays a logo, and limits some features. Paid plans offer unlimited camera use without a logo; platforms are Windows and macOS.

XR Animator is a free tool for driving MMD or VRM 3D avatars from pose input. It uses MediaPipe and TensorFlow.js to detect poses from webcam video, and supports face, full-body, and combined face, body, and hand tracking. Full-body tracking can use a webcam or an image or video file. Face tracking supports 52 ARKit-compatible blendshapes. Users can record motion capture, export VMD, BVH, and glTF motion, and load VMD, FBX, and BVH motion files; FBX or BVH motion can also be exported to VMD. The scene can include 2D images or video, 3D panoramas, and .x or .glb objects. The web app works in major desktop and smartphone browsers, while Electron apps are available for Windows, Linux, and macOS. Android Chrome supports augmented reality. VMC protocol support and a frameless transparent background for capture apps are limited to Electron mode. The project notes that smartphones with limited processing power may be better suited to face tracking alone.