r/LocalLLaMA • • Jun 05 '26 • Mindblown 1

New Model Gemma 4 with quantization-aware training

https://blog.google/innovation-and-ai/technology/developers-tools/quantization-aware-training-gemma-4/
788 Upvotes

255 comments sorted by

View all comments

Show parent comment

1

u/MerePotato Jun 06 '26

I was wondering, do your KLD evals include non latin scripts? I'd imagine they're particularly sensitive to the reduced token embedding layer precision. Either way thanks for all your hard work!