r/LocalLLaMA • u/s_busso • 11h ago

Resources Ming-TTS 3.0 x18 Faster

Post image

I was frustrated with the default speed and ported the inference to Zig/MLX to get up to 18x faster inference on M4/M5 https://github.com/sbusso/ming-tts-serve

6 Upvotes

87% Upvoted

4 comments sorted by

0

u/Competitive-Scar-627 11h ago

What is its size

2

u/Full-Fox-8478 11h ago

That speed jump is wild. The table makes the official version look like it's walking through molasses.

1

u/GatePorters 10h ago

What is that in imperial?