Resemble AI released Chatterbox Multilingual V3 on June 10, 2026. It is an open-source text-to-speech (TTS) model based on Llama with 0.5 billion parameters. Just as GPT can understand and respond to any text, Chatterbox converts any text into natural-sounding speech in 25 languages. It can replicate a speaker's voice (zero-shot voice cloning) with just a short audio sample of 5-20 seconds, and its voice expressiveness can be precisely controlled, ranging from monotonous recitation to dramatic acting, through Classifier-Free Guidance (CFG) and exaggeration parameters. Existing commercial TTS services offer high quality but have fundamental limitations, including cloud dependency, usage-based pricing, and data privacy restrictions. Chatterbox V3 breaks down these barriers with a fully open-source MIT license. In a blind evaluation, it achieved a 63.75% preference rate compared to ElevenLabs, while also enabling commercial deployment without royalties, revenue sharing, or usage restrictions. More noteworthy is the fact that Perceptual Threshold (PerTh) watermarking is built in by default. Utilizing psychoacoustic principles, it inserts a neural watermark that is inaudible to the human ear but survives MP3 compression, telephone codecs, and audio editing, preemptively meeting the AI-generated content labeling requirements of Article 50 of the EU AI Act, which will be implemented in August 2026. V3 supports a total of 25 languages, including 21 base languages and 6 language packs (Mandarin Chinese, Hindi, Brazilian Portuguese, European Portuguese, Latin American Spanish, and European Spanish). It achieves production-level accuracy in major languages, with Italian CER (Character Error Rate) of 0.20%, German less than 0.20%, and English 0.65%. On a single H100 GPU, it achieves a TTFB (Time-to-First-Byte) of less than 300ms and an RTF (Real-Time Factor) of approximately 5x. When deployed with NVIDIA NIM, it offers a 2-39x improvement in throughput compared to unoptimized PyTorch. With 36,700 hours of training data, it improves upon V2 in terms of prompt deviation, repetition, accent drift, and speaker similarity issues. However, Korean (CER 70.90%) and Vietnamese (75.21%) still require additional work before they can be deployed in production.

0.5B parameter, Llama-based, multilingual, open-source TTS model.

Building Multilingual Voice Agents: Integrate Chatterbox Multilingual V3 into a customer service chatbot to generate customized voice responses for key markets such as French, German, and Spanish. Deploy with NVIDIA NIM to handle hundreds of concurrent sessions, and ensure AI-generated voice traceability with PerTh watermarking.