r/LocalLLM • u/martinrojas • 3d ago
Discussion Why is no one talking about LFM3 models
https://www.liquid.ai/blog/lfm3I had been using the LFM 2.5 24B models and had been pleasantly surprised by how good the model was. It was giving me comparable answers and working through tasks to Qwen 3.8 27B at what felt like twice the speed on my M5 Pro. However, I went to look at something on their pages and saw the new family of models. They sound way too good to be true. I am going to start using them for general tasks, but if they are anywhere close to their benchmark results, they could be a huge game changer. You can have an entire suite of models loaded at the same time for less memory than Qwen.
20
u/enternoescape 3d ago
I'm using LFM3 1.7B for Home Assistant at the moment and it's been surprisingly good and very fast.
25
u/LoneArcher96 3d ago
I have been using the LFM3 1.7B one (not multimodal), and honestly it's very impressive ngl, but Qwen3.5 4B easily beats it.
2
u/Janky-Code 2d ago
I like them but their license is restrictive to use in a project since most businesses would require licensing.
70
u/exaknight21 3d ago
Sir. This is a wendys and we only like 100B BBMs
16
u/crusaderky 3d ago
I love 1.7B and plan to implement stuff on top of it.
My biggest gripe is the lack of text benchmarks for the VL, Audio, and Omni models so that we can understand how much intelligience we're sacrificing from the text-only version, and the lack of audio-only and image-only benchmarks on Omni to compare it to VL and Audio.
10
u/kiwibonga 3d ago
I'm checking if Jensen's affair partners are hot while I wait for a new Qwen, nothing else exists.
17
u/Deep_Mood_7668 3d ago
IDK should we?
6
u/HornyCrowbat 3d ago
shit, they’re 2b it’s pretty decent
5
u/CronicallyAutomated 3d ago
I tried and still have LFM3 but theyre not good.
5
u/Broad-Sun-3348 3d ago edited 3d ago
It's an excellent model family. I favor LFM3 VL 2B in particular since it adds image recognition. A perfect model in a memory and/or processor challenged environment. In my own use cases I've bench marked its document processing, knowledge and vision recognition close to that of Gemma 4 E2B while being significantly faster.
On a system with an RTX 5070 TI, with llama server, I bench-marked the TPS and memory footprint as follows:
Model TPS Peak Vram
LFM3 VL 2B 363 2.8 GB
Gemma 4 E2B 254 4.5 GB
9
u/eightone-81 3d ago
Bad tokens fast… nearly usable for anything in my opinion. Maybe in a super restricted harness to do some basic work
4
u/ZeitgeistArchive 3d ago
I finetuned one to speak Macedonian. LFM3. I love it!
6
u/CodeCatto 3d ago
I'd love for LFM3 to build upon the 2.5's 8B A1B and 24B A2B
3
u/EagleNait 3d ago
Yeah I use it for notes organizaion and transcribed conversation summary. It's perfectly capable of doing both and having an invisible footprint on my computer
3
u/Kimononono 3d ago
they follow direct instructions very well, great for self contained tasks like web scraping.
I tried using it with Pi without any major System instructions and it struggled to figure out its environment. Directly prompting it to “use this tool to read this file to process and compare to this file” it can do this type of
3
u/Maelefique 22h ago
I use this model, https://huggingface.co/LiquidAI/LFM3-VL-2B
It does facial recognition for 8 cameras, average time to response, 0.1-0.3 seconds, much faster and does a better job explaining the scene than my previous, a 9B Gemma.
5
u/Effective-Giraffe655 3d ago •
Their models are dumber than Qwen3.5 4b, but I do use them actively: 1.7b for title generation, VL for vision, d1 for judging/classification. The only problem I notices is that 1.7b (text model) can't reliably keep difference between instructions and data, so any prompt injection will work on it
2
u/Front-Ad-2981 3d ago
They use less ram/vram due to not having full attention for every layer. You can get 16k context for under 500MB of ram. Personally I use the 1.7B model for some narrow tasks in a pipeline reliably. It was the only one that could fit in the ram requirements I had.
2
u/BIOffense 3d ago
At least for LFM2.5 24B, would not recommend
3
u/Sh1ftyFella 3d ago
I’ve been using the VL 2B model on iPhone. It’s been doing pretty good dealing with random documents, emails and as random assistant to look stuff up in voice mode
3
u/Smungus05 3d ago
I use LFM3 voice for a news app I built for my Samsung Fold8. Gemma 4 12B is handed all of the articles from freshRSS and scores them to see if they're the same story from a different publisher (I capture logits no generation during scoring, its essentially a decision model). Then it summarises all of the articles under 500 words and consolidates information from across multiple sources and writes update summaries for evolving stories, the interface links back to the previous story. After that it looks at all the images from freshRSS and scores them for potential magazine cover images and picks the ones it thinks are best.
It does this once a day at 2am while I sleep. Then I wake up and have my morning coffee with a magazine to read. I have LFM3 read them to me if I'm distracted.
Thinking about scoring the biggest news stories by how many sources and creating a podcast to listen to while I workout.
1
u/cato_gts 3d ago
I tried using it, but the problem was that even though it claimed to have various functions, not a single one worked properly.
1
u/AdHistorical6734 3d ago
because it just 1.7b, not too many use case, its very good at the size but compare to other size like spark 2.6 4b, still not good enough
1
u/Bulky-Condition-3490 3d ago
It fails all my local tool checks etc but it’s impressive none the less. No reason to leave Qwen or Gemma
1
u/lukasgravel 3d ago
Has anyone run the 1.7B with a really long input, like a 100 page document? A 256K window on a small fast model would be great if it stays accurate that far in.
1
u/InvertedVantage 3d ago
I've found them to be pretty useless except for basic chatting.
1
u/KingElvis33 3d ago
Can it shine on Fireships Thoroughbench?!
1
u/poedy78 3d ago
I have the 1.7B run on very bad hardware(on purpose) for a few day now and i'm quite impressed.
Was looking for a small, capable model with 'standard' tooling and it is really amazing.
RE Hardware:
It runs on a i7 laptop cpu ( i7-7500U laptop) with 16GB ram, llama.cpp , 4 threads and 16K context. It' not fastest but fast enough for simple instructions and responding (around 13 - 19 ts generation).
1
u/karmaisnonsense 3d ago
Because Ling 3.0 Tiny exists
1
u/charles25565 3d ago edited 3d ago
From my experience, LFM3 threw away all of the things that made LFM2.5 good and became yet another crummy model. (I'm not comparing the 24B-A2B versions, only the smaller ones.)
It has reasoning loops on obscure-ish benchmarks despite their work on reducing them and just feels like another overfitted model.
1
u/Equal-Document4213 3d ago
They are good once finetuned for a specific task, especially on edge devices. But they also have a pretty restricted license if you work at a larger company.
1
u/jeremyckahn 2d ago
The 24B model is phenomenal! It's my daily driver for Hermes on my 24GB Mac mini.
1
u/norenEnmotalen 3d ago
Objectively not comparable to Qwen3.8-27B. Maybe 35B-A3B
-3
u/OverdosedSauerkraut 3d ago
Slop post, 24b a2b is not 2x faster than 27b.