Linly-Dubbing
github.com
What it is
Linly-Dubbing is an open-source tool for translating and dubbing videos into Chinese and other languages. It combines speech recognition and speaker recognition with translation options using OpenAI models, locally run Qwen, or Google Translate. Documented voice synthesis choices include Edge TTS, XTTS, CosyVoice, and GPT-SoVITS; voice cloning can generate speech resembling the original video's voice. Linly-Talker lip-sync technology aligns dubbed speech with the video. The tool can add subtitles and background music, adjust music volume, change playback speed, separate vocals from accompaniment, and download video and audio through yt-dlp. Setup instructions describe a local WebUI and use of Python 3.10, PyTorch 2.3.1, and CUDA 11.8 or 12.1, with Windows and Linux model-download instructions. A Colab script is also linked for online use. Installation requires configuring dependencies, downloading models, and setting environment variables, and may use external service credentials depending on configuration. The project is licensed under Apache License 2.0; its releases page lists no releases.
Spec sheet
- Product
- Linly-Dubbing is an intelligent multilingual AI dubbing and translation tool.Read 9 Oct 2026 · github.com
- License
- The project is licensed under Apache License 2.0.Read 9 Oct 2026 · github.com
- External credentials
- The setup guide lists optional credentials or tokens for OpenAI, Hugging Face, Bytedance TTS, and Baidu Ernie Bot, and says most users only need MODEL_NAME and HF_TOKEN.Read 9 Oct 2026 · github.com
- Installation
- The project is installed from its Git repository and launched as a local WebUI at 127.0.0.1:6006.Read 9 Oct 2026 · github.com
- Languages
- It supports dubbing and subtitle translation in Chinese and other languages.Read 9 Oct 2026 · github.com
- License and releases
- The repository identifies the project as Apache License 2.0 and its releases page currently states that there are no releases.Read 4 Oct 2026 · github.com
- Lip sync
- The project integrates Linly-Talker's digital human lip-sync technology for synchronizing dubbing with video visuals.Read 9 Oct 2026 · github.com
- Online option
- The README links to a Colab script for an online experience.Read 4 Oct 2026 · github.com
- Privacy and rights
- The project asks users to comply with copyright, data protection, and privacy laws and not use the tool without the original author's or rights holder's permission.Read 9 Oct 2026 · github.com
- Privacy and use
- The project warns users to comply with copyright, data protection, and privacy laws and to obtain permission from rights holders.Read 4 Oct 2026 · github.com
- Requirements
- The README says installation is very slow and requires configuring dependencies, downloading models, and setting environment variables.Read 9 Oct 2026 · github.com
- Setup
- The documented setup uses Python 3.10, PyTorch 2.3.1, and CUDA 11.8 or 12.1, with local WebUI launch instructions.Read 4 Oct 2026 · github.com
- Speech recognition
- It uses AI speech recognition for speech-to-text conversion and speaker recognition.Read 9 Oct 2026 · github.com
- Speech synthesis
- Documented speech synthesis options include Edge TTS, XTTS, CosyVoice, and GPT-SoVITS.Read 9 Oct 2026 · github.com
- Supported environments
- The installation instructions give Linux and Windows model-download commands and list test setups using Python 3.10, PyTorch 2.3.1, and CUDA 11.8 or 12.1.Read 9 Oct 2026 · github.com
- Translation
- The project describes translation through OpenAI models, locally run Qwen, and Google Translate.Read 4 Oct 2026 · github.com
- Translations
- Documented translation options include OpenAI models, local Qwen, and Google Translate.Read 9 Oct 2026 · github.com
- Video download
- The README describes automatic video and audio downloading with yt-dlp from YouTube and other sites.Read 9 Oct 2026 · github.com
- Video downloads
- The documentation describes automatic video downloading through yt-dlp, including support for YouTube and other websites.Read 4 Oct 2026 · github.com
- Video processing
- The tool can add subtitles and background music, adjust music volume, and change playback speed.Read 4 Oct 2026 · github.com
- Video tools
- Video processing can add subtitles and background music, adjust background music volume, and change playback speed.Read 9 Oct 2026 · github.com
- Vocal separation
- The project documents Demucs and UVR5 for separating vocals and accompaniment.Read 4 Oct 2026 · github.com
- Voice cloning
- Its listed features include AI voice cloning intended to match the original video's tone and emotion.Read 9 Oct 2026 · github.com
- Voice synthesis
- Documented speech synthesis options include Edge TTS, XTTS, CosyVoice, and GPT-SoVITS.Read 4 Oct 2026 · github.com
- Windows and Linux
- The README provides model-download instructions for Windows and Linux.Read 4 Oct 2026 · github.com
Strong points and limits
Strong points
- Supports multiple speech synthesis options.
- Can clone voices and synchronize lip movements.
- Adds subtitles and background music to video.
- Offers vocal separation and yt-dlp downloads.
Limits
- Installation requires dependency and environment configuration.
- Some configurations may require external credentials.
- The releases page lists no releases.
Who it suits
It suits people who want a configurable video dubbing workflow on Windows or Linux, with local setup or a linked Colab option. Users should be prepared to configure dependencies and respect copyright, data protection, and privacy requirements.
Verdict
Linly-Dubbing combines translation, voice generation, video processing, and lip synchronization in one project. Its setup demands configuration, and users should secure rights and permissions before processing material.
Where Specifiction places it
- AI Dubbing Software#21 of 267.6