Model overview
OmniVoice is a massively multilingual zero-shot text-to-speech (TTS) model supporting over 600 languages. Built on a novel diffusion language model-style architecture, it delivers high-quality speech with superior inference speed, supporting voice cloning and voice design. - **Paper:** OmniVoice: Towards Omnilingual Zero-Shot Text-to-Speech with Diffusion Language Models - **Repository:** GitHub - **Demo:** Hugging Face Space - **Colab:** Google Colab Notebook - **600+ Languages Supported**: The broadest language coverage among zero-shot TTS models. - **Voice Cloning**: State-of-the-art voice cloning quality from a short reference audio. - **Voice Design**: Control voices via assigned speaker attributes (gender, age, pitch, dialect/accent, whisper, etc.). - **Fine-grained Control**: Non-verbal symbols (e.g., `[laughter]`) and pronunciation correction via pinyin or phonemes. - **Fast Inference**: RTF as low as 0.025 (40x faster than real-time). - **Diffusion Language Model-style Architecture**: A clean, streamlined, and scalable design that delivers both quality and speed.
The summary below is compiled from sources by an AI model, not our own testing. Verify selection decisions against original sources and your workload.
Key features
- 支持600多种语言的零样本文本转语音,为当前零样本TTS模型中语言覆盖最广者
- 基于扩散语言模型风格架构,兼顾高质量语音合成与极快推理速度(RTF低至0.025)
- 支持短参考音频的高保真语音克隆,以及通过性别、年龄、音高、口音等属性进行细粒度语音设计
Limitations & considerations
Sources are insufficient to establish specific limitations. Verify task performance, latency, data policies, licensing and version lifecycle.
Source prices & cost analysis
Prices vary by channel, region and configuration. Channel quotes are listed independently and are not treated as a single official provider price.
| Source / channel | Input | Output | Billing unit | Collected at |
|---|---|---|---|---|
| No verified prices yet. Check the source channel. | ||||
Estimate monthly base token costs
Estimates exclude cache discounts, tiered pricing, multimodal surcharges, web search, taxes and additional reasoning output.
Public benchmarks & run configuration
暂无已采集的可核验公开评分。模型未上榜不代表能力较低。
View full indexed rankings →Frequently asked questions
OmniVoice是否需要目标语言的训练数据?
不需要;OmniVoice为零样本TTS模型,无需目标语言的训练数据即可合成语音。
能否在不提供参考语音的情况下生成特定说话人声音?
不能;语音克隆需提供短参考音频,语音设计功能可调节属性但不支持完全无参考的说话人身份生成。
模型是否公开许可信息?
未声明;资料中明确指出许可信息‘须核验模型卡’,当前输入未提供有效许可条款。
Do open weights permit free commercial use?
Not necessarily. Check the version license, commercial conditions and usage policies. Self-hosting incurs compute and maintenance costs.
Are these real-time billing prices?
These are timestamped source snapshots, not live billing prices. Check the channel for current versions, regions, discounts and billing methods.
Sources & traceability
许可证:未声明,须核验模型卡。模型介绍与第三方评测均以原来源的具体版本和方法为准。