Hallo vs SadTalker
Hallo
fudan-generative-vision.github.ioSadTalker
github.comSide by side
| Figure | Hallo | SadTalker |
|---|---|---|
| Price from | — | Free |
| Free plan | — | Yes |
| Free trial | — | — |
| Open source | — | — |
| Windows | Yes | Yes |
| macOS | — | Yes |
| Linux | Yes | Yes |
| Self-hosted | Yes | Yes |
| Plans published | 0 | 1 |
| Spec score · AI Video Lip Sync Tools | 7.6 (#14) | 7.7 (#12) |
| Founded | 2024 | 2022 |
| License | GitHub identifies the repository as MIT-licensed. | The repository license identifies Apache 2.0 as the SadTalker license, except for listed third-party components. |
| Purpose | Hallo is a system for audio-driven visual synthesis that animates portrait images. | SadTalker generates a talking-head video from a single portrait image and speech audio. |
Plans
In their own words
Hallo
Hallo generates an animated portrait video from a still image and driving speech audio. Its hierarchical audio-driven synthesis is designed to align lip, facial-expression, and pose movement with the audio, while separate inference weights let you adjust those three motion areas. The source image should be square, show a forward-facing face occupying 50%–70% of the frame, and have less than 30 degrees of rotation. Driving audio must be a clear-vocal English WAV file; background music is allowed. Inference saves an MP4 to `.cache/output.mp4` by default, with another output path available. Listed requirements are Ubuntu 20.04 or 22.04 and CUDA 12.1, with an A100 named as the tested GPU. Pretrained checkpoints and supporting models are available through Hugging Face. The project lists Linux, Windows, and self-hosted platforms, with community resources for Windows, ComfyUI, a WebUI, Docker, and RunPod. Its repository includes preprocessing and training code for multi-node and multi-GPU work. Hallo is free, open source under MIT, and its training data is English, so driving audio is limited to English.
SadTalker
SadTalker creates a talking-head video from a portrait image and speech audio. It derives 3D head-pose and facial-expression coefficients from the audio to animate the face. The project describes still, reference, and resize modes, along with full-image animation. Command-line examples include GFPGAN enhancement. You can use a local Gradio demo or command-line inference, with setup paths for Linux, Windows, and macOS; Hugging Face and Colab demos are also linked. The documented Linux setup includes Python 3.8, PyTorch, FFmpeg, and the repository requirements. Windows setup also calls for Python, Git, FFmpeg, and model files. Pre-trained models are linked from Google Drive, GitHub Releases, and Baidu. The project says its open-source code runs offline and collects no personal information or other data. SadTalker is free at free under Apache 2.0, except for listed third-party components. Output is 720p or lower and has no watermark. Integrations include Discord and a Stable Diffusion WebUI extension.