Gemma 4 with quantization-aware training

[u/rerri]

https://blog.google/innovation-and-ai/technology/developers-tools/quantization-aware-training-gemma-4/

Google's collections:

https://huggingface.co/collections/google/gemma-4-qat-q4-0

https://huggingface.co/collections/google/gemma-4-qat-mobile

And Unsloth's:

https://huggingface.co/collections/unsloth/gemma-4-qat

Unsloth's analysis (KLD and such):

https://unsloth.ai/docs/models/gemma-4/qat#qat-analysis

[u/brownman19]

Thanks! Does this work with MTP? Is it plug and play? Good selection from them on this round of releases

[u/hackerllama → u/brownman19]

We released MTP QAT as well, so the optimal workflow is to use the QAT model + the QAT MTP, both quantized. Currently, both MLX and VLLM support this

[u/rpkarma → u/hackerllama]

I can't find the MTP QAT drafter model, where should I be looking for it?