Linly-Dubbing vs Unmixr Dubbing

Linly-Dubbing is an open-source tool for translating and dubbing videos into Chinese and other languages. It combines speech recognition and speaker recognition with translation options using OpenAI models, locally run Qwen, or Google Translate. Documented voice synthesis choices include Edge TTS, XTTS, CosyVoice, and GPT-SoVITS; voice cloning can generate speech resembling the original video's voice. Linly-Talker lip-sync technology aligns dubbed speech with the video. The tool can add subtitles and background music, adjust music volume, change playback speed, separate vocals from accompaniment, and download video and audio through yt-dlp. Setup instructions describe a local WebUI and use of Python 3.10, PyTorch 2.3.1, and CUDA 11.8 or 12.1, with Windows and Linux model-download instructions. A Colab script is also linked for online use. Installation requires configuring dependencies, downloading models, and setting environment variables, and may use external service credentials depending on configuration. The project is licensed under Apache License 2.0; its releases page lists no releases.

Unmixr Dubbing converts speech into dubbed video or audio by transcribing it, translating the script, and assigning AI voices to detected speakers. Users can choose distinct voices, edit translated lines, split or merge segments, and regenerate changed segments. Timing and speaking speed can be adjusted segment by segment. Exports include dubbed media and translated subtitles in SRT and VTT formats. Uploads can be up to 60 minutes; MP4, MOV, MP3, and WAV are listed as common formats. The dubbing page describes support for 100+ languages, while plan details list 85. Dubbing does not re-animate lips or change video frames. A free account includes 5,000 credits and watermarked exports up to three minutes, with no trial; the seven-day trial instead includes 20,000 credits. Paid plans start at $9 a month. Background music separation is available on paid recurring plans, but not in the trial. The service is listed for web and API platforms, though the Lite plan has no developer API.