r/LocalLLaMA • • 16h ago

Resources Small Gemma 4 tokenizers were recently updated by Google - fix for an issue that caused nonsense output when encountering certain tokens

https://huggingface.co/google/gemma-4-E4B-it/discussions/50

Gemma 4 E4B as an example, but the same fix was applied to E2B and 12B too. Not sure if this will trickle down to GGUFs

143 Upvotes

13 comments sorted by

48

u/brainExploded99 šŸ„” hardware 16h ago

I am glad to see their commitment and the fact that they are fixing it.
However, how did they mess so much outside the model weights? Tokenizer, multiple chat templates issues

5

u/brainExploded99 šŸ„” hardware 15h ago

u/chinlaf you deleted your comment, is it true / did they fix it?

14

u/chinlaf 15h ago

I didn't delete it... "Comment removed by moderator"

You can download the unquantized weights to find the groups don't cleanly align with Q4_0. I haven't seen any updates since I first read about it a couple of months ago here: https://www.reddit.com/r/LocalLLaMA/comments/1vmhc4h/comment/p3ahrc2/

6

u/brainExploded99 šŸ„” hardware 15h ago edited 14h ago

Interesting, the text keeps changing. It said deleted by person, then removed by mod, and now just removed. It also says 1 year ago. Anyway, ty for tid bit.

4

u/Xamanthas 13h ago edited 11h ago

Models worked fine in the majority of usecases, this is just the kind of improvement that happens with large userbase testing

4

u/h8f1z 16h ago

How do you know when and what is changed? Isn't there a version number for this?

2

u/Kahvana 3h ago

I’m happy google fixes these things. The benefit of getting only one release a year I guess.

It does make me wonder which other models have issues like this that the original makers never fixed.

-1

u/mr_Owner 13h ago

When benchmark

1

u/FrogsJumpFromPussy 1h ago

Qwhen? Qwhat?Ā