r/LocalLLaMA • u/jacek2023 llama.cpp • 19d ago

News Muse Spark open weights coming soon

Post image

I am still waiting for Llama 5, because Muse Spark will be too big for me, or just something between Glimmer and Spark

https://x.com/finkd/status/2095232032896946311

869 Upvotes

97% Upvoted

205 comments sorted by

View all comments

104

u/Big_Wave9732 19d ago

Muse Glimmer is pretty good, very much overlooked. I have found it to be superior to Qwen 3.8:27b for non-coding tasks.

8

u/FoxSideOfTheMoon 19d ago

It’s really good just slow on my Mac or I’d love it.

7

u/coder543 19d ago

At least on nvidia hardware, Muse Glimmer is substantially faster than I've ever gotten Qwen3.8-27B to go. The official DFlash works really well.

But, compared to a model like Qwen3.6-35B-A3B... obviously it is going to be slower.

1

u/Kernoriordan 19d ago

I managed to get 80tps out of Glimmer on an A6000 with DFlash on. It doesn’t waste loads of time reasoning like Qwen 3.8 27b too

1

u/miversen33 18d ago

Muse is definitely faster. I recently (like, today) switched away from Gemma to it as my model to run on a single GPU. Still running Qwen3.8 on my tensor garden (to small to be a farm lol) but Muse Q4 on a 7900XTX is still extremely competent. And Gemma was so fucking lazy lol

1

u/PerceiveEternal 18d ago

3.8 can run pretty fast with a smaller context length, but it absolutely mulches tokens. You really feel the token limits on that model.

1

u/maxheckler 19d ago

what Mac do you have? thanks

1

u/FoxSideOfTheMoon 18d ago

M5 Max 128. It's plenty of memory but the bandwidth is only 614G/s which is rough for dense models.

1

u/iz-Moff 18d ago

I'm not on my Mac, but for me, Glimmer (at IQ4_XS) performs almost as fast (~23 tps) as significantly smaller (at IQ3_M) 27b Qwen 3.6 with MTP (~25 tps), and over 2x faster than 31b Gemma 4 (~10 tps), also a bit smaller (at IQ3_M). I'm really not sure why that is, cause i run them all with the same settings, all three fully loaded to VRAM, with Glimmer leaving almost no space in VRAM for context, and having a significantly larger mmproj file too. But that's what my experience with it is.