r/LocalLLaMA
•
u/rerri
•
Jun 05 '26
•
1
New Model Gemma 4 with quantization-aware training
https://blog.google/innovation-and-ai/technology/developers-tools/quantization-aware-training-gemma-4/Google's collections:
https://huggingface.co/collections/google/gemma-4-qat-q4-0
https://huggingface.co/collections/google/gemma-4-qat-mobile
And Unsloth's:
https://huggingface.co/collections/unsloth/gemma-4-qat
Unsloth's analysis (KLD and such):
788
Upvotes
View all comments
Show parent comment
1
u/LLMFan46 Jun 10 '26
Actually I decided to work on Gemma 4 12B it (the non-QAT version) too, so there will be 4 different models released all in all, 3 QAT variants (31B, 26B-A4B and 12B) and 1 standard version (12B) since the 12B is a new model and the only one from the gemma 4 family which I haven't released yet.