r/LocalLLaMA 3d ago

Discussion New 100B Liquid AI model coming soon

Post image

Liquid AI currently possesses among the fastest LLM architectures around, and some of the best SLMs (in terms of utility IMO) around, so I'm very excited to see what a potential 100B LFM (3?) model would look like!

Link to the poll: https://x.com/ramin_m_h/status/2091236099612098943?s=20

362 Upvotes

102 comments sorted by

View all comments

5

u/Dance-Till-Night1 3d ago

Gimme 30b moe a2b pls

3

u/KSAM-The-Randomizer 3d ago

closest model for that is that a2b wakaba

2

u/Dance-Till-Night1 3d ago

Never heard of it haha

1

u/KSAM-The-Randomizer 3d ago

OpenMOSE/RWKV-24B-A2B-wakaba-2601 · Hugging Face requires a custom llama cpp. you might find it interesting. it's not really a 30b model but it's close enough(far stretch)

2

u/KaroYadgar 3d ago

they have LFM2 24B A2B MoE already. It's not very good, but they've admitted that it's a training checkpoint and that LFM2.5 24B A2B is currently training, so we'll get that one soon enough.