Skip to content
SPECIFICTION
Get listed

XR Animator

sao.animetheme.com

From $3/mo Free plan Open source WebWindowsmacOSLinuxAndroidSelf-hosted
Visit sao.animetheme.com
Spec score 8.6 #9 of 63 in Motion Capture Software

What it is

XR Animator is a free tool for driving MMD or VRM 3D avatars from pose input. It uses MediaPipe and TensorFlow.js to detect poses from webcam video, and supports face, full-body, and combined face, body, and hand tracking. Full-body tracking can use a webcam or an image or video file. Face tracking supports 52 ARKit-compatible blendshapes. Users can record motion capture, export VMD, BVH, and glTF motion, and load VMD, FBX, and BVH motion files; FBX or BVH motion can also be exported to VMD. The scene can include 2D images or video, 3D panoramas, and .x or .glb objects. The web app works in major desktop and smartphone browsers, while Electron apps are available for Windows, Linux, and macOS. Android Chrome supports augmented reality. VMC protocol support and a frameless transparent background for capture apps are limited to Electron mode. The project notes that smartphones with limited processing power may be better suited to face tracking alone.

Spec sheet

What it does
XR Animator uses MediaPipe and TensorFlow.js pose detection from webcam or media input to drive VRM or MMD 3D avatars.Read 14 Oct 2026 · github.com
Integrations
In Electron mode, VMC protocol can animate models in VMC-enabled applications such as VSeeFace, VNyan, and Warudo.Read 3 Oct 2026 · github.com
Android AR
The web app supports augmented reality on Android Chrome.Read 3 Oct 2026 · github.com
Android requirement
AR mode requires an ARCore-supported phone, Chrome for Android and WebXR.Read 14 Oct 2026 · github.com
API and extensibility
Release 0.35.0 documents VMC over WebSocket plus external 3D-camera data reception and transmission.Read 14 Oct 2026 · github.com
Augmented reality
Android Chrome devices meeting Google ARCore and WebXR requirements can run the AR mode.Read 14 Oct 2026 · github.com
Avatar formats
Users can load VRM or MMD models as avatars.Read 14 Oct 2026 · github.com
Browser performance
The README reports up to 60 fps rendering and 30 fps body-pose detection on a mediocre PC when web workers and OffscreenCanvas are supported.Read 14 Oct 2026 · github.com
Changelog history
The changelog records the v11 transition to a browser app, webcam/media AI mocap, VRM support and BVH/FBX motion support.Read 14 Oct 2026 · github.com
Company identity
The repository identifies the creator and copyright holder as Butz Yung / Anime Theme.Read 14 Oct 2026 · github.com
Depth backdrop
A 2D image can receive an automatically generated AI depth map for use as a 3D backdrop.Read 14 Oct 2026 · github.com
Developer libraries
The project credits Electron, three.js, three-vrm, MediaPipe, TensorFlow.js, Transformers.js, PeerJS and osc-js among its core dependencies.Read 14 Oct 2026 · github.com
Documentation depth
Documentation consists mainly of the GitHub README, release notes, video tutorials and linked setup guidance rather than a separate API documentation portal.Read 14 Oct 2026 · github.com
Early-access pricing
Ko-fi lists Silver Supporter at $3 per month and Gold Supporter at $10 per month for member access to Android early releases.Read 14 Oct 2026 · ko-fi.com
Face tracking
The application supports face tracking with 52 ARKit-compatible blendshapes.Read 14 Oct 2026 · github.com
Full-body tracking
A single webcam or image/video file can provide full-body motion capture.Read 14 Oct 2026 · github.com
Hand tracking
Face, body, hands and fingers can be tracked in combined modes.Read 14 Oct 2026 · github.com
Independent directory status
iTechGuides lists one free plan, no paid tier, and no reader reviews yet.Read 14 Oct 2026 · itechguides.com
Inputs
Full-body motion tracking accepts a single webcam or an image or video file.Read 3 Oct 2026 · github.com
Licence concern
Hysen Labs reports that GitHub has no detectable licence file and cautions that commercial reuse may require permission, conflicting with the README's CC BY-NC-SA statement.Read 14 Oct 2026 · hysenlabs.com
Licence stated by maker
The repository README assigns XR Animator source adaptations a Creative Commons Attribution-NonCommercial-ShareAlike 4.0 licence and excludes third-party assets.Read 14 Oct 2026 · github.com
Limit: desktop-only features
VMC output and transparent capture backgrounds are restricted to Electron mode.Read 14 Oct 2026 · github.com
Limit: iPhone integration
A Reddit discussion says the advertised 52 blendshapes did not provide direct integration with iPhone TrueDepth or popular facial-tracking apps.Read 14 Oct 2026 · reddit.com
Limit: maintenance risk
Hysen Labs notes that the maintainer has warned financial pressure could force the project to stop and that membership releases precede public releases.Read 14 Oct 2026 · hysenlabs.com
Limit: mobile performance
The maker warns that phones with limited processing power may need face tracking only.Read 14 Oct 2026 · github.com
Limit: tracking reliability
Reddit users report body tracking or mocap recording not working in some setups and ask for help with jitter and configuration.Read 14 Oct 2026 · reddit.com
Motion conversion
FBX, BVH and VRMA motions can be exported to VMD.Read 14 Oct 2026 · github.com
Motion formats
It can record mocap and export VMD, BVH, and glTF motion, load VMD, FBX, and BVH motions, and export FBX or BVH motions to VMD.Read 3 Oct 2026 · github.com
Motion import
The software loads VMD, FBX, BVH and VRMA motion files.Read 14 Oct 2026 · github.com
Motion recording
Captured motion can be recorded and exported as VMD, BVH or glTF.Read 14 Oct 2026 · github.com
Native-only features
VMC protocol support and a frameless transparent background for capture apps such as OBS are Electron-mode features.Read 3 Oct 2026 · github.com
Object tracking
Webcam object tracking can map real-world objects to 3D props.Read 14 Oct 2026 · github.com
OBS capture
Electron mode provides a frameless transparent window for capture software such as OBS.Read 14 Oct 2026 · github.com
Performance caveat
The project notes that smartphones with limited processing power may be better suited to face tracking only.Read 3 Oct 2026 · github.com
Praise: free workflow
Haishin Donya describes it as useful for trying full-body webcam tracking before purchasing dedicated trackers and labels it free.Read 14 Oct 2026 · haishindonya.jp
Praise: interoperability
Hysen Labs highlights that the tool reads and writes several motion formats and can drive other applications through a live protocol.Read 14 Oct 2026 · hysenlabs.com
Praise: production use
An independent Japanese user reports creating motion from video and editing the exported result in MMD.Read 14 Oct 2026 · knb-mayumi.com
Rating on iTechGuides
8.7 out of 10 from 1 editorial scoreRead 14 Oct 2026 · itechguides.com
Scene customization
Scenes can use 2D images or video, 3D panoramas and .x or .glb objects.Read 14 Oct 2026 · github.com
Scenes
Users can customize the 3D scene with 2D images or video, 3D panoramas, and .x or .glb objects.Read 3 Oct 2026 · github.com
Self-hosting
Release 0.35.0 adds running XR Animator as a localhost web app on any operating system with Node.js installed.Read 14 Oct 2026 · github.com
Support and access
The maker invites donations and membership support, which includes early access to the latest version at least six months before public GitHub release.Read 3 Oct 2026 · github.com
Support channels
The project lists Discord, YouTube, X/Twitter, Ko-fi, FANBOX, PayPal and an email address as contact or support routes.Read 14 Oct 2026 · github.com
System requirement
The project reports 20-plus fps pose/finger tracking, 40-plus fps face tracking and 60 fps rendering on an entry-level GTX1650-class PC.Read 14 Oct 2026 · github.com
Tracking
It supports face, full-body, and combined face, body, and hand tracking.Read 3 Oct 2026 · github.com
VMC integration
Electron mode sends avatar animation through VMC protocol to VSeeFace, VNyan, Warudo and other compatible applications.Read 14 Oct 2026 · github.com
Web and desktop
The web app works in major desktop and smartphone browsers; downloadable Electron apps are available for Windows, Linux, and macOS.Read 3 Oct 2026 · github.com

Plans and prices

Free public version Free Free Web app and downloadable desktop versions · no paid tier required Read 14 Oct 2026 · github.com
Silver Supporter $3 a month $3.00 per month Membership access · password-protected Android early-access ZIP releases Read 14 Oct 2026 · ko-fi.com
Gold Supporter $10 a month $10.00 per month Membership access · password-protected Android early-access ZIP releases Read 14 Oct 2026 · ko-fi.com

Every XR Animator plan and price →

Strong points and limits

Strong points

  • Supports face, full-body, and combined tracking
  • Records and exports motion in several formats
  • Works in major desktop and smartphone browsers
  • Free public version

Limits

  • VMC support is limited to Electron mode
  • Transparent capture background is Electron-only
  • Limited-power smartphones may suit face tracking only

Who it suits

XR Animator suits people who want to animate MMD or VRM avatars using webcam, image, or video input. It may also suit users building scenes or sending motion to VMC-enabled applications through Electron mode.

XR Animator in depth

Read the full write-up

XR Animator is a webcam-driven motion tool for MMD and VRM 3D avatars, best suited to creators who want both live tracking and reusable motion files. Its range of tracking and export options makes it unusually versatile for a free tool, though phone performance and Electron-only features shape the best setup.

Overview

XR Animator uses MediaPipe and TensorFlow.js to turn webcam poses into avatar movement. Full-body tracking can also use an image or video file, and recording lets creators take motion beyond a live session. That combination suits people exploring capture workflows or building motion assets without paying for the software.

The trade-off is processing demand: the project cautions that smartphones with limited power may be better suited to face tracking alone. For full-body work, a desktop browser or Electron app is the more sensible choice; this is not the right pick if demanding tracking must run reliably on a modest phone.

Key features

Tracking and avatars

Tracking covers face, full body, or face, body, and hands together. Face tracking supports 52 ARKit-compatible blendshapes, while the combined mode can provide more expressive performance than face tracking alone. XR Animator drives MMD and VRM avatars and supports VRM import, making it relevant to 3D avatar creators rather than users seeking a 2D avatar workflow.

Motion files and integrations

It records motion and exports VMD, BVH, and glTF. It can also load VMD, FBX, and BVH motion, and convert FBX or BVH motion to VMD. This format range is useful for creators moving between live capture and animation projects, though the formats supported for export differ from those supported for loading.

In Electron mode, VMC can send animation to compatible applications such as VSeeFace, VNyan, and Warudo. Electron also enables a frameless transparent background for capture apps such as OBS. Those are meaningful reasons to choose the downloadable app over the browser version if streaming integration is central to the setup.

Scenes and augmented reality

Scenes can combine 2D images or video, 3D panoramas, and.x or.glb objects. The web app also supports augmented reality on Android Chrome, giving mobile users an additional way to work with scenes, subject to the phone's processing limits.

Pricing

The Free public version costs nothing and includes the software's stated tracking, recording, and motion workflow. There are no paid tiers described. The maker invites donations and membership support; membership includes early access to the latest version at least six months before its public GitHub release. That is a support option with earlier access, not a stated requirement for using the free public version.

Platforms

The web app runs in major desktop and smartphone browsers, and Android Chrome supports augmented reality. Downloadable Electron apps are available for Windows, Linux, and macOS. VMC protocol support and the frameless transparent background are Electron-only, so browser users give up those capture and integration features.

Who it's for

XR Animator is a strong fit for 3D avatar creators who want several tracking modes, motion recording, and broad motion-file handling without a software price. It is especially useful when a desktop workflow can use Electron for VMC connections or transparent capture. It is a weaker fit for phone-first full-body capture, or for creators who need a 2D avatar workflow.

Pros and cons

Pros: Face, full-body, and combined face/body/hand tracking give creators a choice of capture scope.

Pros: Recording plus VMD, BVH, and glTF export, alongside VMD, FBX, and BVH loading, supports both performance and motion-file workflows.

Pros: The free public version has no stated software charge, and web access spans desktop and smartphone browsers.

Cons: Limited smartphone processing power may make face-only tracking the practical option, ruling out some phone-first full-body use.

Cons: VMC and transparent capture backgrounds require Electron, so browser users cannot rely on those features.

Alternatives

For a broader browse of related tools, see VTuber Software, AI Motion Capture Software, and Motion Capture Software.

Choose Animaze instead if its Android, iOS, API, or Windows platform coverage and freemium model better suit your setup; its Plus plan is $3.99 a month, billed $47.88/year shown, and removes the watermark, adds Animaze Original content, and enables 60 FPS streaming.

VTube Studio is the more fitting alternative for Live2D model support, webcam or smartphone tracking, and voice-based lip-sync, with a free plan on Android, iOS, macOS, and Windows.

Consider Webcam Motion Capture if you want to try all tracking features for free on iOS, macOS, or Windows, or prefer its prepaid 90- or 360-day access options.

nizima LIVE offers a free iOS, macOS, and Windows plan with one user per month, 40-minute continuous camera use, a displayed logo, and some feature limits; choose it if those terms fit your sessions.

veadotube is a free alternative for Linux, macOS, and Windows, with an optional paid early-access tier.

PNGTuber Plus is free on Linux, macOS, and Windows and focuses on PNG avatar customization and sprite sheets.

VRL Cam is an iOS option with a free app that includes every app feature for personal and non-commercial use, plus individual creators below US $100,000 annual gross revenue.

vTuber Kit is another free option for Linux, macOS, and Windows.

Verdict

Choose XR Animator if you want a free 3D avatar workflow that combines flexible tracking with motion recording and file export. Its main advantage is the breadth of capture and motion tools without a software price; look elsewhere if full-body tracking must run on a low-powered phone or if you need VMC and transparent capture without using Electron.

Verdict

XR Animator offers several tracking modes, motion formats, and scene options at no listed cost. Check which features require Electron and whether a smartphone has enough processing power for the intended tracking.

Where Specifiction places it

Alternatives to XR AnimatorAll alternatives →