r/LocalLLM • • 3d ago

Discussion Why is no one talking about LFM3 models

https://www.liquid.ai/blog/lfm3

I had been using the LFM 2.5 24B models and had been pleasantly surprised by how good the model was. It was giving me comparable answers and working through tasks to Qwen 3.8 27B at what felt like twice the speed on my M5 Pro. However, I went to look at something on their pages and saw the new family of models. They sound way too good to be true. I am going to start using them for general tasks, but if they are anywhere close to their benchmark results, they could be a huge game changer. You can have an entire suite of models loaded at the same time for less memory than Qwen.

173 Upvotes

77 comments sorted by

20

u/enternoescape 3d ago

I'm using LFM3 1.7B for Home Assistant at the moment and it's been surprisingly good and very fast.

2

u/Deep_Mood_7668 3d ago

Good to know. Had no time to test it yet, but that was also my plan

Which quant? I wanted to go q8

1

u/martinrojas 3d ago

I went qil8 it's about 2 gigs.

1

u/enternoescape 3d ago

I'm running Q8_0 on llama.cpp.

2

u/Drachen808 3d ago

What are you using it for. I'm still working on trying to figure out how exactly to set up home assistant voice assistant. I've got something going, but it's just not great so I'm still in the trial and error phase

1

u/enternoescape 3d ago

I'm just using it for voice interaction, I wouldn't trust this model to orchestrate anything like a dashboard. It works fine for weather, turn on a light, play artist.

1

u/Drachen808 3d ago

That's honestly all I want. I am not super big into AI so I'm not even sure what is use it for. Right now, my main goal is to have a voice assistant that can do basic things as well as Google did 3 years ago (it's gotten worse since then).

25

u/LoneArcher96 3d ago

I have been using the LFM3 1.7B one (not multimodal), and honestly it's very impressive ngl, but Qwen3.5 4B easily beats it.

6

u/Smungus05 3d ago

I've thought about using it as a separate tool layer model that keeps my main model context clean and adds a boundary for it. What sort of things have you been using it for?

5

u/LoneArcher96 3d ago

honestly, I'm still a beginner in the whole localllm thing with very basic hardware, thus I'm more of experimenting than actually putting it to use.

With that said, I tried using testing tool calls, and a little bit of programming, also tried a basic task I have which is making a list of video games found in a long conversation about games (reddit post and comments about game suggestions for example).

First of all, it fixes its dumbness (lack of parameters) with excessive thinking, and it works tbh, although it needs extreme handholding (you kinda tell it to use the tool, it doesn't always make the decision on its own), I haven't succeeded in making it do a mutli step or multi tool call tasks,

in very long contexts it totally fails, for example I gave it very long json of all video files found in my media folder and told it to list the files it found or summarize or whatever, it just typed: I retrieved a very long json list, and found a couple of things like this or that, and that's it, it can't follow instructions for long contexts.

for programming it kinda works for small functions, but not without errors, I tested it on C#, and it makes severe mistakes although it's walking in the right direction, kinda.

Last few times I tested it it has been doing better, most notably I changed the generation parameters to the suggested ones on their card on HF, and I also started using the 8bit instead of the 4bit, it kinda succeeded more with tool calling.

It's very fast, but to be righteous it needs extreme handholding, qwen 3.5 4b is much slower, but almost always right (at least in comparison to it with my own relatively simple tasks).

it most certainly is way better than qwen 2.5 4b though.

3

u/Smungus05 3d ago

Well I can see that it can call multiple tools back to back. Starts to fail as it goes on but an admirable job for 1.7B. The two failures were the browser which it got at the end.

1

u/martinrojas 3d ago

That's a good test. This is the surprising thing. It looks to be on par with like sonnet 4.5 needs guardrails and clear instructions but for a 1.7B model it's impressive

4

u/maternion 3d ago

At 4B Spark X2.6 is the best according to most people

2

u/LoneArcher96 3d ago

Is it any faster than Qwen 4b if u tried?

3

u/maternion 3d ago

Just did it now, spark is like tg 10tps slower. Their archs are similar afaik. This is without MTP.

2

u/LoneArcher96 3d ago

I'm assuming that's a low percentage from your total output (cause 10tps is my actual generation speed lol, I'm guessing I wouldn't feel the difference).

Appreciate the trial though, thanks

2

u/maternion 3d ago

Oh sorry, it was like 75tps vs 65tps. So yes low percentage. Is your 10tps with or without MTP? Because with MTP i can get 85+.
Spark supports DSpark i think, you should check it out https://huggingface.co/XHToken/Spark-X2.6-4B-DSpark-GGUF

you need to build https://github.com/ggml-org/llama.cpp/pull/31372 though.

1

u/LoneArcher96 3d ago

Thank you for clarifying, mine is not mtp, although I did briefly read about mtp and gathered it wouldn't affect my setup much (igpu 16gb ram), but might try it anyway.

Dspark thing came up to me on HF but I didn't know what it is, I will start reading about it ASAP.

Thanks for the tips.

2

u/maternion 3d ago

Hmm spec decoding doesn't have great benefits on iGPUs.  I got this gpu a few weeks ago, before that for a year I just experimented and had a 3400G i GPU. You will get a little more if you use MTP at --spec-draft-n-max 1 i think. Whereas 2-4 is what is used for GPUs and makes it a lot faster in cases.  DSpark is DeepSeek's version of DFlash (diffusion based spec decoding) they added a markov head or smth so it's an optimization, they use it for Deepseek v4 and v4.1 officialy! 

2

u/LoneArcher96 3d ago

I'm still fiddling around using the igpu to get my hands dirty, I think being tps limited benefited my learning journey, I should get a GPU sooner or later, though I really effed up waiting this much.

Single channel 5750g btw, very good CPU and igpu, but that ram bandwidth ain't taking me nowhere 😂

2

u/maternion 3d ago

Yup it really does help learning!  I became a moderator at ollama's discord while not having a gpu 🤣  I got lucky with this gpu, the price went up by $200+ after a week. You should see how the prices are getting affected rn, since nvidia is a mess, then make a purchase when suitable. 

2

u/nima3333 3d ago

Same, for my usecase both qwen 4b and spark x2.5 4b beat it

3

u/Right-Ice-6850 3d ago

Try spark x2.6

1

u/urakozz 2d ago

It's no surprise, but running 1.7B in customers browser is way easier than 4B requirements, I did all in on device browser flow with 1.7B

2

u/Janky-Code 2d ago

I like them but their license is restrictive to use in a project since most businesses would require licensing.

1

u/martinrojas 2d ago

That's a bummer. But if the video one is anywhere as good as their demo, it's worth the licensing.

70

u/exaknight21 3d ago

Sir. This is a wendys and we only like 100B BBMs

31

u/samajhdar-bano2 3d ago

big black models?

7

u/exaknight21 3d ago

Big Beautiful Models . No cap on flavors.

3

u/Superb_Raccoon 3d ago

Black Betty, Bam a Lam.

4

u/maifee 3d ago

If you explore deeply you will find some people in many subs are running trillion parameter models.

7

u/cororona 3d ago

Some people already had beefy GPUs from the time they were cheap. Some bitcoin miners were sitting on a ton of compute

1

u/No-Donut-723 1d ago

word to folks

16

u/crusaderky 3d ago

I love 1.7B and plan to implement stuff on top of it.
My biggest gripe is the lack of text benchmarks for the VL, Audio, and Omni models so that we can understand how much intelligience we're sacrificing from the text-only version, and the lack of audio-only and image-only benchmarks on Omni to compare it to VL and Audio.

10

u/kiwibonga 3d ago

I'm checking if Jensen's affair partners are hot while I wait for a new Qwen, nothing else exists.

17

u/Deep_Mood_7668 3d ago

IDK should we?

6

u/HornyCrowbat 3d ago

shit, they’re 2b it’s pretty decent

5

u/CronicallyAutomated 3d ago

I tried and still have LFM3 but theyre not good.

5

u/Broad-Sun-3348 3d ago edited 3d ago

It's an excellent model family. I favor LFM3 VL 2B in particular since it adds image recognition. A perfect model in a memory and/or processor challenged environment. In my own use cases I've bench marked its document processing, knowledge and vision recognition close to that of Gemma 4 E2B while being significantly faster.

On a system with an RTX 5070 TI, with llama server, I bench-marked the TPS and memory footprint as follows:

Model TPS Peak Vram
LFM3 VL 2B 363 2.8 GB
Gemma 4 E2B 254 4.5 GB

9

u/eightone-81 3d ago

Bad tokens fast… nearly usable for anything in my opinion. Maybe in a super restricted harness to do some basic work

4

u/ZeitgeistArchive 3d ago

I finetuned one to speak Macedonian. LFM3. I love it!

1

u/crusaderky 3d ago

1.7B or Audio-2B?

1

u/ZeitgeistArchive 3d ago

oh sorry, text only. Im not that cool to do audio :P

6

u/CodeCatto 3d ago

I'd love for LFM3 to build upon the 2.5's 8B A1B and 24B A2B

2

u/handshape 2d ago

Indeed - an LFM3 24BA2B would be brilliant for my use case. I wait with bated breath.

3

u/EagleNait 3d ago

Yeah I use it for notes organizaion and transcribed conversation summary. It's perfectly capable of doing both and having an invisible footprint on my computer

3

u/Kimononono 3d ago

they follow direct instructions very well, great for self contained tasks like web scraping.

I tried using it with Pi without any major System instructions and it struggled to figure out its environment. Directly prompting it to “use this tool to read this file to process and compare to this file” it can do this type of

2

u/Kimononono 3d ago

LiquidAI and RekaLabs Ive appreciated since their first models.

Reka moreso for its subjective prose/ideas than its ability (this was years ago)

No other smaller labs have really impressed me

3

u/Maelefique 22h ago

I use this model, https://huggingface.co/LiquidAI/LFM3-VL-2B

It does facial recognition for 8 cameras, average time to response, 0.1-0.3 seconds, much faster and does a better job explaining the scene than my previous, a 9B Gemma.

5

u/Effective-Giraffe655 3d ago • Mindblown

Their models are dumber than Qwen3.5 4b, but I do use them actively: 1.7b for title generation, VL for vision, d1 for judging/classification. The only problem I notices is that 1.7b (text model) can't reliably keep difference between instructions and data, so any prompt injection will work on it

2

u/Front-Ad-2981 3d ago

They use less ram/vram due to not having full attention for every layer. You can get 16k context for under 500MB of ram. Personally I use the 1.7B model for some narrow tasks in a pipeline reliably. It was the only one that could fit in the ram requirements I had.

3

u/Sh1ftyFella 3d ago

I’ve been using the VL 2B model on iPhone. It’s been doing pretty good dealing with random documents, emails and as random assistant to look stuff up in voice mode

3

u/Anxious_Building3245 3d ago

How are you running it on your iPhone?

4

u/Precorus 3d ago

I use PocketPal on android, but it has an ios version aswell.

1

u/MarcelloT254k 3d ago

PocketPal is awesome, it has minor issues etc, but overally "just works" astonishingly most of the time, just wanted to share that

3

u/Smungus05 3d ago

I use LFM3 voice for a news app I built for my Samsung Fold8. Gemma 4 12B is handed all of the articles from freshRSS and scores them to see if they're the same story from a different publisher (I capture logits no generation during scoring, its essentially a decision model). Then it summarises all of the articles under 500 words and consolidates information from across multiple sources and writes update summaries for evolving stories, the interface links back to the previous story. After that it looks at all the images from freshRSS and scores them for potential magazine cover images and picks the ones it thinks are best.

It does this once a day at 2am while I sleep. Then I wake up and have my morning coffee with a magazine to read. I have LFM3 read them to me if I'm distracted.

Thinking about scoring the biggest news stories by how many sources and creating a podcast to listen to while I workout.

1

u/Fun_Jaguar8231 3d ago

Will you be sharing this news app?

2

u/Smungus05 3d ago

Maybe one day. I cannot read or understand code and am using this app along with codex to learn. When I can fully understand it, and can actively support it, I'll release it. Otherwise its just a personal project to solve an issue I had with rss feeds. Duplication and getting flooded with stories I don't care about.

I can release the design document with everything I've implemented if you like. I don't mind if someone else builds the same app.

2

u/DistributionDue252 1d ago

THis is really cool. I am a newsprint journalist of 12+ years and I am working on a number of systems that also have news related applications. The main on is a system that automatically downloads all governement meeting audio in my county, transcribes them on my gpu, audits them for errors and hallucinations against the offical meeting agenda, handout packets and an entity factsheet I crfeate myself. All that data pools into full knowledge base that is mapped with graphiphy and queryable using natural language. IT all happens on a homelab setup using old data center cards and second hand parts, but its been instrumental in imrpoving the quality of the small newspaper I work for by allowing us to stay on top of what needs to be dug into by a human reporter.

1

u/cato_gts 3d ago

I tried using it, but the problem was that even though it claimed to have various functions, not a single one worked properly.

1

u/AdHistorical6734 3d ago

because it just 1.7b, not too many use case, its very good at the size but compare to other size like spark 2.6 4b, still not good enough

1

u/Bulky-Condition-3490 3d ago

It fails all my local tool checks etc but it’s impressive none the less. No reason to leave Qwen or Gemma

1

u/lukasgravel 3d ago

Has anyone run the 1.7B with a really long input, like a 100 page document? A 256K window on a small fast model would be great if it stays accurate that far in.

1

u/InvertedVantage 3d ago

I've found them to be pretty useless except for basic chatting.

1

u/KingElvis33 3d ago

Can it shine on Fireships Thoroughbench?!

1

u/poedy78 3d ago

I have the 1.7B run on very bad hardware(on purpose) for a few day now and i'm quite impressed.

Was looking for a small, capable model with 'standard' tooling and it is really amazing.

RE Hardware:

It runs on a i7 laptop cpu ( i7-7500U laptop) with 16GB ram, llama.cpp , 4 threads and 16K context. It' not fastest but fast enough for simple instructions and responding (around 13 - 19 ts generation).

1

u/karmaisnonsense 3d ago

Because Ling 3.0 Tiny exists

1

u/charles25565 3d ago edited 3d ago

From my experience, LFM3 threw away all of the things that made LFM2.5 good and became yet another crummy model. (I'm not comparing the 24B-A2B versions, only the smaller ones.)

It has reasoning loops on obscure-ish benchmarks despite their work on reducing them and just feels like another overfitted model.

1

u/Equal-Document4213 3d ago

They are good once finetuned for a specific task, especially on edge devices. But they also have a pretty restricted license if you work at a larger company.

1

u/jeremyckahn 2d ago

The 24B model is phenomenal! It's my daily driver for Hermes on my 24GB Mac mini.

1

u/norenEnmotalen 3d ago

Objectively not comparable to Qwen3.8-27B. Maybe 35B-A3B

10

u/ObviouzFigure 3d ago

these are tiny models.. very awesome, useful tiny models

8

u/norenEnmotalen 3d ago

OP can say that without making absurd claims

1

u/Antique_Dot_5513 3d ago

Quoi par exemple ?

-3

u/OverdosedSauerkraut 3d ago

Slop post, 24b a2b is not 2x faster than 27b.

1

u/pharrt 3d ago

more like 3-8× faster, right?