AudioGen vs SoundFactory

AudioGen is a text-to-sound model provided through AudioCraft. It generates audio samples from text descriptions and can continue from an audio prompt, with conditional and unconditional generation modes. Sampling controls include greedy, temperature, top-K, and top-P methods. The listed pretrained model, facebook/audiogen-medium, has 1.5 billion parameters; the example API generates sound and saves it as WAV. The implementation uses an autoregressive Transformer and a 16 kHz EnCodec tokenizer. The repository provides API access and a local Jupyter notebook demo. Running the medium model locally requires a GPU with at least 16 GB of memory; installation requires Python 3.9 and PyTorch 2.1.0, with ffmpeg recommended. The model was trained on English descriptions and performs less well in other languages. It cannot generate realistic vocals, and prompts may need refinement. Code is MIT-licensed, while weights use CC-BY-NC 4.0; training datasets are not provided. The listed self-hosted plan is free.

SoundFactory has no write-up on Specifiction yet; its figures are above.