AI Tools
Audio AIIntermediate

VoxCPM2

Open-source, next-generation text-to-speech model that generates natural-sounding speech in a continuous acoustic space.

OpenBMB's VoxCPM2, officially released in April 2026, is an innovative next-generation text-to-speech system based on open-source technology. It generates natural-sounding speech within a continuous acoustic space, as if a person were speaking directly. To overcome the limitations of existing speech models, which divided subtle sound units into mechanical tokens, leading to computational bottlenecks or unnatural word combinations, it organically connects the MiniCPM large language model backbone with an improved high-resolution audio encoder architecture. By departing from the conventional discontinuous audio token transformation process, which converts text into mechanical sound fragments and outputs them, it introduces a tokenizer-free architecture that directly reconstructs the continuous waveform and texture of the sound, enabling the realization of 48kHz studio-quality audio output even in local environments.

While traditional text-to-speech methods involve breaking down text words into small units, converting them into mechanical pronunciation symbols or discontinuous tokens, and then synthesizing them into audio, VoxCPM2 directly infers a continuous acoustic space, creating a natural waveform with no breaks or artificial tonal distortions. Just as a large language model reads the flow of previous context and naturally continues a sentence, VoxCPM2 organically weaves together the subtle breaths and accents from the beginning to the end of the sound. It offers voice design, which allows users to create new voice personas simply by describing emotions and vocal characteristics in text, and zero-shot voice cloning, which replicates a unique timbre with just a short audio clip.

This model provides both powerful performance and flexibility for researchers building global services that require multilingual support or artificial intelligence voice agents. Researchers can use VoxCPM2 to transmit synthesized speech that naturally transcends languages in real-time streaming from over 30 major multilingual datasets. It can be widely used, from leveraging local GPU resources to mass-produce emotionally rich audio from text scripts in just a few seconds, to developing customized pipelines that utilize efficient fine-tuning techniques such as LoRA to precisely learn even the subtle linguistic habits of a specific speaker.

💻 System Requirements

🧠RAM

Minimum 8GB (consumer-grade GPU such as NVIDIA RTX 3060 recommended), CPU-only/MPS support available

💾Storage

Approximately 10GB or more (including model weights and dependency packages)

Installation

4-1. Quick Start

pip install voxcpm

4-2. Detailed Installation

# Clone the repository and install dependencies
git clone https://github.com/OpenBMB/VoxCPM.git
cd VoxCPM
pip install -r requirements.txt

# (Optional) Run the web interface for LoRA fine-tuning
python lora_ft_webui.py

FAQ

What is VoxCPM2?

OpenBMB's VoxCPM2, officially released in April 2026, is an innovative next-generation text-to-speech system based on open-source technology. It generates natural-sounding speech within a continuous acoustic space, as if a person were speaking directly. To overcome the limitations of existing speech models, which divided subtle sound units into mechanical tokens, leading to computational bottlenecks or unnatural word combinations, it organically connects the MiniCPM large language model backbone with an improved high-resolution audio encoder architecture. By departing from the conventional discontinuous audio token transformation process, which converts text into mechanical sound fragments and outputs them, it introduces a tokenizer-free architecture that directly reconstructs the continuous waveform and texture of the sound, enabling the realization of 48kHz studio-quality audio output even in local environments. While traditional text-to-speech methods involve breaking down text words into small units, converting them into mechanical pronunciation symbols or discontinuous tokens, and then synthesizing them into audio, VoxCPM2 directly infers a continuous acoustic space, creating a natural waveform with no breaks or artificial tonal distortions. Just as a large language model reads the flow of previous context and naturally continues a sentence, VoxCPM2 organically weaves together the subtle breaths and accents from the beginning to the end of the sound. It offers voice design, which allows users to create new voice personas simply by describing emotions and vocal characteristics in text, and zero-shot voice cloning, which replicates a unique timbre with just a short audio clip. This model provides both powerful performance and flexibility for researchers building global services that require multilingual support or artificial intelligence voice agents. Researchers can use VoxCPM2 to transmit synthesized speech that naturally transcends languages in real-time streaming from over 30 major multilingual datasets. It can be widely used, from leveraging local GPU resources to mass-produce emotionally rich audio from text scripts in just a few seconds, to developing customized pipelines that utilize efficient fine-tuning techniques such as LoRA to precisely learn even the subtle linguistic habits of a specific speaker.

When should I use VoxCPM2?

Open-source, next-generation text-to-speech model that generates natural-sounding speech in a continuous acoustic space.

📄 Official Docs🐙 GitHub

📝 Update Notes

  1. v2.0.36/22/2026

    VoxCPM2 v2.0.3에서는 학습 전 데이터의 오류를 미리 잡아내는 validate 기능이 추가되어, 실험 데이터셋 구축 시 발생할 수 있는 시행착오를 크게 줄여줍니다. 참조 오디오(ref_audio) 지원과 스트리밍 디코딩 성능 개선을 통해 더욱 정교하고 빠른 오디오 생성 및 분석 실험이 가능해졌습니다. 또한, LoRA 로딩 보안 강화와 장치별 안정성 개선은 대규모 데이터를 다루는 연구자들에게 더욱 안전하고 신뢰할 수 있는 컴퓨팅 환경을 제공합니다.

🧪 Related Code of Life

No related Code of Life posts yet.