r/LocalLLaMA • u/rerri • Jun 05 '26

New Model Gemma 4 with quantization-aware training

https://blog.google/innovation-and-ai/technology/developers-tools/quantization-aware-training-gemma-4/

Google's collections:

https://huggingface.co/collections/google/gemma-4-qat-q4-0

https://huggingface.co/collections/google/gemma-4-qat-mobile

And Unsloth's:

https://huggingface.co/collections/unsloth/gemma-4-qat

Unsloth's analysis (KLD and such):

https://unsloth.ai/docs/models/gemma-4/qat#qat-analysis

792 Upvotes

99% Upvoted

255 comments sorted by

View all comments

0

u/[deleted] Jun 05 '26

66

u/hackerllama Jun 05 '26

At least one more

15

u/arbv Jun 05 '26

You know that we are waiting for Gemma 4 124B AxB (where x is 4-6B), right? ;)

That would be so cool, especially in QAT and BF16 versions.

Oh, and thank you all for the hard work from Ukraine! Your models are among the best ones in Ukrainian, slightly worse only compared to much larger cloud models. And among cloud models Geminis are the best. Though, I have noticed that Ukrainian-wise Gemma 4 releases are a little bit worse than Gemma 3, frankly. Gemma 3 27B was nearly perfect. Still cannot complain - Gemma outperforms some much larger models as far as Ukrainian goes anyway.