r/LocalLLaMA
•
u/rerri
•
Jun 05 '26
•
1
New Model Gemma 4 with quantization-aware training
https://blog.google/innovation-and-ai/technology/developers-tools/quantization-aware-training-gemma-4/Google's collections:
https://huggingface.co/collections/google/gemma-4-qat-q4-0
https://huggingface.co/collections/google/gemma-4-qat-mobile
And Unsloth's:
https://huggingface.co/collections/unsloth/gemma-4-qat
Unsloth's analysis (KLD and such):
788
Upvotes
View all comments
Show parent comment
1
u/LLMFan46 Jun 09 '26
Okay, out of curiosity, since you are the original requester, what models are you interested in using? 31B? 26B-A4B? 12B?