NVIDIA AR SDK

Spec sheet

Purpose

The SDK provides AI features for real-time modeling and tracking of human faces and bodies from video.Read 7 Oct 2026 · catalog.ngc.nvidia.com

Intended users

The catalog describes the SDK as a resource for developers building video processing applications with AI-powered AR features.Read 7 Oct 2026 · catalog.ngc.nvidia.com

Platforms

The catalog lists x86-64 Windows and Linux support; the user guide also describes Windows on Arm support with feature restrictions.Read 7 Oct 2026 · catalog.ngc.nvidia.com

Deployment

The user guide includes instructions for running the SDK in a Linux container.Read 7 Oct 2026 · docs.nvidia.com

Support

The catalog directs NVIDIA AI Enterprise customers to the NVIDIA AI Enterprise Support Portal and documentation hub.Read 7 Oct 2026 · catalog.ngc.nvidia.com

License

Use is governed by NVIDIA's Software License Agreement and Product-Specific Terms for NVIDIA AI Products; associated models follow the license specified for each model.Read 7 Oct 2026 · catalog.ngc.nvidia.com

Access

The catalog says users need to be logged in to an NGC account to download the SDK Core.Read 7 Oct 2026 · catalog.ngc.nvidia.com

Additional features

The SDK also includes facial expression estimation, LipSync animation from audio, and Active Speaker Detection using video and synchronized audio.Read 7 Oct 2026 · docs.nvidia.com

Body pose

3D Body Pose Estimation predicts 77 body keypoints in 2D and 3D camera coordinates from video frames.Read 7 Oct 2026 · docs.nvidia.com

Core package

The Core package contains runtime libraries, development headers and APIs, documentation, integration guides, feature installation scripts, and a README.Read 7 Oct 2026 · catalog.ngc.nvidia.com

Distribution

The SDK Core and optional features are distributed through NVIDIA GPU Cloud (NGC), and the Core package provides a script to fetch features from NGC.Read 7 Oct 2026 · catalog.ngc.nvidia.com

Eye Contact

Eye Contact estimates gaze angles and can redirect a person's eyes toward the camera within a permissible range.Read 7 Oct 2026 · docs.nvidia.com

Face features

Face detection and tracking uses bounding boxes, while facial landmark tracking predicts 68 or 126 landmark points and head poses.Read 7 Oct 2026 · docs.nvidia.com

Features

Features include face detection and tracking, facial landmark tracking, body pose estimation, eye contact, facial expression estimation, LipSync, and active speaker detection.Read 7 Oct 2026 · docs.nvidia.com

GPU processing

The SDK uses NVIDIA GPUs with Tensor Cores for high-throughput, low-latency processing.Read 7 Oct 2026 · catalog.ngc.nvidia.com

Integration

NVIDIA provides sample applications demonstrating the SDK features in a GitHub repository.Read 7 Oct 2026 · catalog.ngc.nvidia.com

NIM containers

The catalog lists Eye Contact and LipSync as available AR SDK features in ready-to-deploy NIM containers.Read 7 Oct 2026 · catalog.ngc.nvidia.com

Samples

NVIDIA links sample applications for all AR SDK features from its GitHub repository.Read 7 Oct 2026 · catalog.ngc.nvidia.com

Windows on Arm limit

On Windows on Arm, LipSync and Active Speaker Detection are unsupported, and only the Body Pose Estimation or Body Detection path is available.Read 7 Oct 2026 · docs.nvidia.com

Where Specifiction places it

• Augmented Reality Software#17 of 197.1