Clony AI vs SoulX-Singer

Clony AI has no write-up on Specifiction yet; its figures are above.

SoulX-Singer is a singing voice synthesis model that generates voices for singers it has not been tuned on. Pitch, rhythm, and expression can be guided by melody-conditioned F0 contours or score-conditioned MIDI notes. Its voice-conversion system changes raw singing audio to a target singer’s voice while retaining melody, rhythm, and lyrics, without requiring lyric or MIDI transcriptions. It supports Mandarin Chinese, English, and Cantonese, plus singer-timbre cloning, cross-lingual synthesis, and lyric editing while retaining natural prosody. Preprocessing tools handle vocal separation, dereverberation, F0 extraction, voice activity detection, and lyric and note transcription. Users can edit MIDI metadata, including lyrics, phoneme alignment, pitches, and durations, before synthesis. Soul-AILab provides generation and conversion demos and a separate MIDI editor through Hugging Face Spaces; the repository also supports local inference. Code and model weights use the Apache 2.0 license. Maintainers caution that automatic preprocessing may misalign singing with lyrics and notes, so manual correction may be needed.