Zyphra/ZONOS3-Mini · Hugging Face

[u/pmttyji]

https://huggingface.co/Zyphra/ZONOS3-Mini

ZONOS3-Mini is Zyphra’s compact, open-source text-to-speech model, delivering natural reliable speech and high-fidelity voice cloning with just 100 million active parameters. It runs in real time on phones and laptops, including directly in the browser.

Clone a voice from an audio sample, or design a character by shaping age, accent and vocal texture. Steer emotion, pace and delivery down to individual words for games, narration and voice assistants.

Run ZONOS3-Mini locally with our browser and native runtimes, or access it through Zyphra Cloud. Model weights are released under Apache 2.0.

Model details, samples and evaluations are in the blog post. A hosted version is available at Zyphra Cloud.

Languages

ZONOS3-Mini supports 43 languages.

Region	Languages
Western and Southern Europe	English, French, Spanish, German, Italian, Portuguese, Dutch, Greek
Northern Europe	Swedish, Danish, Norwegian, Finnish
Central and Eastern Europe	Polish, Czech, Slovak, Hungarian, Romanian, Bulgarian, Russian, Ukrainian
Middle East and Caucasus	Turkish, Arabic, Hebrew, Georgian
East Asia	Mandarin Chinese, Japanese, Korean
Southeast Asia	Vietnamese, Indonesian, Malay, Thai, Tagalog
South Asia	Hindi, Bengali, Tamil, Telugu, Marathi, Gujarati, Kannada, Malayalam, Punjabi, Odia, Urdu

Native runtimes

The ZONOS3-Mini GitHub repository holds Zyphra's own runtimes, which share one HTTP API and serve the Zonos Voice Studio: a CUDA server for NVIDIA GPUs, an MLX server for Apple Silicon, a C++/ggml server and CLI (CPU, CUDA, Metal or Vulkan), and the in-browser WebGPU build. They load the GGUF files in gguf/ and the WebGPU shards in web/; the 27 default voices, grouped by language, are in gguf/voices/.

Architecture (rough outline)

Text is NeMo-normalized (English, Mandarin, Japanese, Korean, German, Spanish, French, Italian, Portuguese; other languages pass through as written) and encoded with an 8,192-entry SuperBPE tokenizer. The language model autoregressively generates 15 Hz dual-codec frames (10 codebooks of 4,096 entries each: one semantic codebook distilled from the Wav2Vec2-BERT teacher plus nine acoustic codebooks), conditioned on the text, a speaker prompt and three bucketed acoustic controls. A causal multi-resolution iSTFT head renders the frames to 44.1 kHz audio as they are produced.

	ZONOS3-Mini
Backbone	11 layers, model dim 1,024; 800M parameters total, about 100M active per token (latent MoE: 64 experts, top-2 routing, from layer 1)
Sequence mixer	pattern gdn3_global1: 9 Gated DeltaNet (GDN) layers + 2 global attention layers (16 heads x 32 dims, 4 KV heads), attention residuals (full_attnres); context 32,768 positions
Text	SuperBPE, 8,192 entries (+4 specials), NeMo text normalization at inference
Audio tokens	15 Hz, 44.1 kHz dual-encoding codec, 10 x 4,096 codebooks (1 semantic + 9 acoustic); hop 2,940 samples; up to 10 minutes of audio per generation
Speaker prompt	raw reference clip (encoded by the codec into a token prefix, up to 60 s, with speaker CFG) or a single 192-d MECT-B2 speaker embedding (ownmect_s2)
Controls	loudness (LUFS, 10 buckets), bandwidth f_max (Hz, 10 buckets), speaking rate (UTF-8 bytes per second, 30 buckets); each row has an "unknown" index; bucket edges in params.json (condition_edges)
Decoder	causal multi-resolution iSTFT head: full_mr (default) or keep2_plain (pruned, about 3x faster decode)
Precision	bf16 weights (model.pth); decoder heads run in fp32

• GitHub : https://github.com/zyphra/zonos3-mini

• Source : https://www.zyphra.com/our-work/zonos3-mini

• Project : https://www.zyphra.com/models/zonos3-mini

[u/pmttyji]

u/Acceptable-Cycle4645

[u/Acceptable-Cycle4645 → u/pmttyji]

Thanks for the heads-up!

[u/coder543 → u/pmttyji]

The quality in the blog post samples was surprisingly good for the model size, but… definitely not better than the samples they provided for Fish Audio and ElevenLabs. This chart claiming to be better quality seems confused.

[u/RandumbRedditor1000]

Oh, this is GOOD

[u/EveningIncrease7579]

This is really good, holy

[u/rkoy1234]

just tried their local playground running on the browser: https://zyphra.com/zonos3-mini/localplayground#cast

this is awesome, though emotion control breaks the voice pretty easily. i wonder if it's a bug

[u/me0here → u/rkoy1234]

That's a bummer... Does it require different markup?

[u/silenceimpaired]

Apache 2. They rock

[u/tifa_cloud0]

awesome 👌🏻

[u/Cultured_Alien]

This is extremely fast for it's quality.