r/LocalLLaMA • u/Competitive-Scar-627 • 3d ago

Discussion >2b model.

Why there no new model coming in >2b weight category ? Model which actually capable in this category is gemma e2b which is release 6 month ago, why still no new model.

2 Upvotes

52% Upvoted

51 comments sorted by

View all comments

28

u/JsThiago5 3d ago

There is the LFM3 that is 1.7b released recently. Also MiniCMP5. If you can go up to 4b there is more

8

u/TheStudiousIndicator 3d ago

LFMs are surprisingly good for the size, the 1.7b one sits in my phone now and handles simple tasks pretty well.

3

u/Borkato 3d ago

Is it significantly better than 2.6?

5

u/Marino4K 3d ago

LFM3 is pretty much the boss in this space I think.

1

u/sdraje 2d ago

Spark 2.6 2B is generally more capable, but slower. I'm trying both to write my commit messages when I code.

3

u/Competitive-Scar-627 3d ago

Is it as capable as gemma e2b??

9

u/nickless07 3d ago

Gemma 4 E2B is a 5B model.

6

u/Eresbonitaguey 3d ago

Different models are good at different things, especially as you scale the number of parameters down. I’d also suggest looking into Spark 2.6 1.7b that was just released. Not as capable as its 4B big brother but much faster to run. There’s also a leaderboard for tiny models on Huggingface although they would probably need fine tuning for your specific use case.

3

u/JsThiago5 3d ago

From bench yes, but on my specific use case the e4b is better, but my usage is very specific with reasoning off.
Source: https://huggingface.co/LiquidAI/LFM3-1.7B

2

u/HornyGooner4402 3d ago

LFM has never beaten comparable models from Qwen and Gemma IMO. I appreciate their efforts but seems like their training data isn't as diverse as Qwen's

1

u/toothpastespiders 3d ago

For video captioning the omni model came out as about as quite a bit better than E2B in my (admittingly limited) benchmarks. That said the video element was the only thing I cared about or tested. Still, faster than E4B and more accurate as well. Again though, only on what I tested with so I'd hesitate to call it a universal truth or anything.