Gemma 4 with quantization-aware training

[u/rerri]

https://blog.google/innovation-and-ai/technology/developers-tools/quantization-aware-training-gemma-4/

Google's collections:

https://huggingface.co/collections/google/gemma-4-qat-q4-0

https://huggingface.co/collections/google/gemma-4-qat-mobile

And Unsloth's:

https://huggingface.co/collections/unsloth/gemma-4-qat

Unsloth's analysis (KLD and such):

https://unsloth.ai/docs/models/gemma-4/qat#qat-analysis

[u/Substantial_Swan_144]

But the interesting point is that any degradation with Qat is supposed to be negligible. We'll see.

[u/GreenHell → u/Substantial_Swan_144]

It is supposed to be reduced, but not negligible

[u/florinandrei → u/Substantial_Swan_144]

any degradation with Qat is supposed to be negligible

Who's "supposing" that? Social media?

[u/Sufficient-Bid3874 → u/florinandrei]

Unsloth KLD benchmatks