CHAMELAION LipSync API vs MakeItTalk

CHAMELAION LipSync API takes video and audio input and produces a video with lip movements matched to the audio. It accepts MP4 video and WAV or MP3 audio by public URL or direct upload. Active-speaker detection runs automatically but can be disabled for an individual request. The maker says the model retains speaker identity, speaking style, and expressions while adapting mouth movements to new audio. Listed uses include dubbing and translation, AI avatars, creative ads, and dialogue replacement or personalization. SDKs are listed for Python 3.8+ and TypeScript/Node.js 18+. Requests require a Bearer token or x-api-key header, except at the health endpoint; generation endpoints are limited to 60 requests per minute, and concurrent job limits depend on the plan. Starter is free and includes 24,000 tokens and two minutes of translation and lip sync, with a watermark. Basic costs €4.00 per year and lists 60,000 tokens and five minutes. The maker says its servers are in Europe and users retain ownership of generated videos. Profile views may work when the mouth remains visible; extreme close-ups, side views above 90 degrees, and cropped mouths are difficult cases.

MakeItTalk is Linux, self-hosted software that creates expressive talking-head videos from one facial image and an audio track. Audio content drives lip movement and nearby facial motion, while speaker information influences expressions and other talking-head movement. The project describes use with human portraits, paintings, sketches, 2D cartoons, manga, and stylized caricatures, including faces or characters not seen during training. Its repository includes pretrained models, module training code, and Google Colab demos for natural faces. For human faces and paintings, the README calls for a centered 256×256 JPG portrait and a WAV file. Optional command-line settings adjust lip motion on the x and y axes and head-motion displacement. Local setup specifies Python 3.6, ffmpeg, and Python packages; cartoon face warping on Ubuntu also requires winehq-stable. Custom puppets are listed as a to-do item, and training sections for voice conversion, the speaker-aware branch, and image-to-image translation are marked unfinished. It is free open-source research code under CC BY-NC 4.0, allowing noncommercial use under that license.