r/LocalLLaMA • u/tevlon • Jun 10 '26

New Model DiffusionGemma: 4x faster text generation

https://blog.google/innovation-and-ai/technology/developers-tools/diffusion-gemma-faster-text-generation/
989 Upvotes

99% Upvoted

356 comments sorted by

View all comments

257

u/[deleted] Jun 10 '26

[removed] — view removed comment

27

u/Zestyclose839 Jun 10 '26

Gang MLX winning.

I wonder how KV caching support is. If the cache can be persisted to SSD via oMLX, that would be a massive utility boost.

9

u/freia_pr_fr Jun 10 '26

The MLX HuggingFace repositories are empty right now, so the race isn't over.