CHAMELAION LipSync API vs LatentSync
CHAMELAION LipSync API
chamelaion.comLatentSync
github.comSide by side
| Figure | CHAMELAION LipSync API | LatentSync |
|---|---|---|
| Price from | €0.33/mo | Free |
| Free plan | Yes | Yes |
| Free trial | Yes | — |
| Open source | — | Yes |
| Web | Yes | — |
| Linux | — | Yes |
| API | Yes | Yes |
| Self-hosted | — | Yes |
| Plans published | 10 | 1 |
| Spec score · AI Video Lip Sync Tools | 9.1 (#1) | 8.6 (#4) |
| Intended users | The company describes its platform as serving creators, businesses, and organizations, and says it supports audio and video translation into 30 languages. | The README describes an efficient stage-two training configuration as suitable for consumer-grade GPUs such as the RTX 3090. |
| Purpose | The API takes video and audio input and generates a new video with lip movements matched to the audio. | LatentSync is an end-to-end lip-sync method based on audio-conditioned latent diffusion models. |
| What it does | CHAMELAION LipSync creates videos whose mouth movements match a replacement audio track and can be integrated through an API. | LatentSync is an end-to-end lip-sync system that generates mouth movements from audio with latent diffusion and no intermediate motion representation. |
Plans
CHAMELAION LipSync API
- StarterFree
- Basic€4 a year
- Basic€5 a month
- Bronze€20 a year
- Bronze€25 a month
- Silver€96 a year
- Silver€120 a month
- Gold€400 a year
- Gold€500 a month
- EnterprisePriced on request
In their own words
CHAMELAION LipSync API
CHAMELAION LipSync API takes video and audio input and produces a video with lip movements matched to the audio. It accepts MP4 video and WAV or MP3 audio by public URL or direct upload. Active-speaker detection runs automatically but can be disabled for an individual request. The maker says the model retains speaker identity, speaking style, and expressions while adapting mouth movements to new audio. Listed uses include dubbing and translation, AI avatars, creative ads, and dialogue replacement or personalization. SDKs are listed for Python 3.8+ and TypeScript/Node.js 18+. Requests require a Bearer token or x-api-key header, except at the health endpoint; generation endpoints are limited to 60 requests per minute, and concurrent job limits depend on the plan. Starter is free and includes 24,000 tokens and two minutes of translation and lip sync, with a watermark. Basic costs €4.00 per year and lists 60,000 tokens and five minutes. The maker says its servers are in Europe and users retain ownership of generated videos. Profile views may work when the mouth remains visible; extreme close-ups, side views above 90 degrees, and cropped mouths are difficult cases.
LatentSync
LatentSync is a free, open-source lip-sync method for Linux and self-hosted deployment. It uses audio-conditioned latent diffusion models: Whisper converts mel spectrograms into audio embeddings, which enter a U-Net through cross-attention layers. The project offers a Gradio application and command-line inference, plus checkpoints, training code and a data-processing pipeline. LatentSync 1.6 was trained on 512 × 512 videos to address blurry teeth and lips. Minimum inference memory is listed as 8 GB of VRAM for version 1.5 and 18 GB for version 1.6. More inference steps can improve visual quality but slow generation; increasing guidance scale can improve lip-sync accuracy while introducing distortion or jitter. Training configurations for the U-Net require 20–55 GB of VRAM, depending on configuration. The documented pipeline uses PySceneDetect for scene detection and InsightFace landmarks for face transformation. The repository lists Apache-2.0, while the model card lists openrail++.