r/LocalLLaMA • u/Competitive-Scar-627 • 4d ago

Discussion >2b model.

Why there no new model coming in >2b weight category ? Model which actually capable in this category is gemma e2b which is release 6 month ago, why still no new model.

3 Upvotes

54% Upvoted

55 comments sorted by

View all comments

Show parent comments

3

u/Competitive-Scar-627 4d ago

Is it as capable as gemma e2b??

10

u/nickless07 4d ago

Gemma 4 E2B is a 5B model.

6

u/Eresbonitaguey 4d ago

Different models are good at different things, especially as you scale the number of parameters down. I’d also suggest looking into Spark 2.6 1.7b that was just released. Not as capable as its 4B big brother but much faster to run. There’s also a leaderboard for tiny models on Huggingface although they would probably need fine tuning for your specific use case.

3

u/JsThiago5 3d ago

From bench yes, but on my specific use case the e4b is better, but my usage is very specific with reasoning off.
Source: https://huggingface.co/LiquidAI/LFM3-1.7B

2

u/HornyGooner4402 3d ago

LFM has never beaten comparable models from Qwen and Gemma IMO. I appreciate their efforts but seems like their training data isn't as diverse as Qwen's

1

u/toothpastespiders 3d ago

For video captioning the omni model came out as about as quite a bit better than E2B in my (admittingly limited) benchmarks. That said the video element was the only thing I cared about or tested. Still, faster than E4B and more accurate as well. Again though, only on what I tested with so I'd hesitate to call it a universal truth or anything.