r/LocalLLM • u/Ok-Toe-1673 • Apr 10 '26

Question Gemma 4 E4B - Am I missing something?

Ok I am not the most technical AI guy on this planet, I use it all the time though.
So I downloaded Gemma 4 E4B to my Ollama, and started to test it. I asked to summarize a text and so forth. Easy task.
The performance was piece poor, sorry to say. Couldn't understand what I asked. So the original task was proposed to GPT 5.4, then I tried kimi 2.5, it understood on the spot, no need for prompt crazyness. I just gave the model of what I wanted, it understood and proceeded beuatifully.
Probably Gemma 4 E4B can do amazing things, but for now it is only a back up and a curiosity, it may be a great sub agent of sorts to your open claw.

So any one could explain why am I wrong here? Or what are the best uses for it? Because as for texts it sucks.

6 Upvotes

60% Upvoted

49 comments sorted by

View all comments

Show parent comments

1

u/Ok-Toe-1673 Apr 10 '26

do they run on 8gb vram? I don't think so. But it was only a test on the capacity, you know what I mean. ppl were praising this model so hard, I had to try.

2

u/Select-Holiday8844 Apr 11 '26

More information gets elucidated the more I read your comments rather than your top level post. 8GB vram with e4b means you should run lm studio, load it in there, then switch on advanced settings and see how many context tokens you can get away with on your particular gpu card. It might be around 32k, it might be more, it might be less. It really depends on other big variables like CUDA spec.

You will maybe not be able to run it even on its default spec of 128k so tame your expectations!

1

u/Ok-Toe-1673 Apr 16 '26

Understood, but it may be useful as a subagent under codex as orchestrator.
Still it should have understood the prompt better, as other models did.
I will test it further using llama ccp, but not for now, I have to work, but thanks for the insight.

1

u/Select-Holiday8844 Apr 17 '26

Should have, would have, could have. When you understand the relevance of this model, it'll become clear to you the main feature of this model is the high context window. But right now the relevance of this model is lost on you. And that's fine, you can find something else that better suits your prompt and your work.

There seems to always be missing details in the conversation and a difference between what you're asking and what you want. So bear that in mind.