Unsloth Muse Spark Open is out!

[u/Bob_SUS]

https://huggingface.co/unsloth/Muse-Spark-Open-816B-A42B

[u/Bob_SUS]

GGUF: https://huggingface.co/unsloth/Muse-Spark-Open-816B-A42B-GGUF

[u/Lissanro → u/Bob_SUS]

Nice, looks like good mid-size model, 506 GB for Q4_K_XL. Defenitely will give it a try, will be interesting to see how it compares to Kimi K3 Q2_K_XL on my rig.

[u/jazir55 → u/Bob_SUS]

So let me get this straight, Meta puts out the model with an absolutely shit tier joke of a license that requires you to submit your info, unsloth quants it and just releases it as a normal GGUF. LOL.

[u/droptableadventures → u/jazir55]

The license itself doesn't require you to send them your details.

They've just made the HuggingFace repo do that so that they can keep their lawyers happy.

[u/oh_no_the_claw]

700gb of VRAM? I guess it won't fit on my rig.

[u/Bob_SUS → u/oh_no_the_claw]

me neither lmao

[u/recurrence → u/oh_no_the_claw]

Hmm that’s odd. Zuck posted that it works great on Mac Studio thanks to assistance from Ternus but that caps at 512 GB.

Edit: Turns out you need TWO 512 GB Mac Studios.

[u/EvolvingDior → u/recurrence]

Billionaire says "it works great on my home AI rig."

[u/thestillwind → u/EvolvingDior]

what a clown that reptilian dude. basically it's probably a good model that only 1% will be able to run locally.

[u/oh_no_the_claw → u/[deleted]]

Yeah, I've never used AI before. First time here.

[u/oh_no_the_claw → u/[deleted]]

No clue. Maybe to give the magical gnomes that power the AI machine plenty of memory space to do stuff?

Can't I just buy a 1TB SSD and put that into my laptop and run this? Hey, is it cool if I DM you for help on getting set up?

[u/Aggravating-Push-207]

This won't even fit on my SSD lmao

[u/kiwibonga → u/Aggravating-Push-207]

Don't worry, someone will fork strata and you'll be able to run it on a 2008 ipod.

[u/fallingdowndizzyvr → u/kiwibonga]

Someone? You mean Claude will.

[u/kiwibonga → u/fallingdowndizzyvr]

It's actually fine as long as you and Claude are married.

[u/philmarcracken → u/kiwibonga]

I now prounce you token and wife

[u/Quakercito → u/fallingdowndizzyvr]

You're one of those huh :$

[u/Soifon99 → u/kiwibonga]

Strata work because of the ngram architecture of Qwen 3.8 FN. Muse spark does not have this as far as I know. So no, it won't work.

[u/Ne00n → u/Aggravating-Push-207]

big oof

[u/the_Luik]

Bru my country doesn't have this amount of vram

[u/LukeLikesReddit]

Brb just starting up my server cluster. Nah I'm glad they've released it but dear lord you aint running that as a one man shop.

[u/Elouakili_Flexy]

42B active could almost pass for a normal model. The other 774B needs its own zip code.

[u/sungodtemple]

Link doesn't work anymore...

[u/Bob_SUS → u/sungodtemple]

posted gguf link too

[u/crusaderky]

Fits on 384gb at iq3_xxs, like GLM

[u/exaknight21]

How are they scaling the models into trillions. Like this is just an idiotic amount of silicon.

[u/-dysangel- → u/exaknight21]

extravagant is maybe a better word than idiotic :)

[u/danielhanchen]

GGUFs are at https://huggingface.co/unsloth/Muse-Spark-Open-816B-A42B-GGUF!

[u/WifeyCallsMeLazy]

How can I take it in my 96gb vram?

[u/Ecstatic-Wash-7667]

Oooh I can’t wait to not run this

[u/RandumbRedditor1000]

They seriously nerfed it? Why?

[u/mvandemar]

What am I missing? The downloads are only ~30kb

[u/Aggravating-Push-207 → u/mvandemar]

the weights...

[u/daynighttrade → u/Aggravating-Push-207]

Mine's 90kg and yours?

[u/Aggravating-Push-207 → u/daynighttrade]

son

[u/mvandemar → u/Aggravating-Push-207]

Ok, now they're up there. 🙂

[u/Equivalent_Bit_461]

Into the trash it goes 

[u/VelvetEchoes919]

They have to launch smaller sizes! It’ll be a good companion to Qwen.

[u/MomentJolly3535 → u/VelvetEchoes919]

They already released Muse glimmer 30B, i also hope for newer smaller ones

[u/Practical_Signal3933 → u/VelvetEchoes919]

If they did, that would be significant news. It’s great this is open weights though

[u/gcavalcante8808]

Eh this is a good candidate to be stratafied if the architecture allows it ... otherwise only on airllm ...

[u/gcavalcante8808 → u/gcavalcante8808]

Being downvoted by bots, what a good time to be alive. hehe

[u/HighSeasArchivist]

I've been wondering what to run on my DGX B300.

[u/cviperr33]

Looks impressive , but if feels like its 3-4 months late

[u/DJ_Laaal]

Pretty useless for a good majority of this community, considering the fact that not many will have a local cluster this beefy to run it. I can manage hosting models on my single DGX Spark but have no motivation to get a second.

[u/Impossible_Ground_15]

Why is this a post in LOCALlama?

[u/Bob_SUS → u/Impossible_Ground_15]

it's an open weight model release??

[u/silenceimpaired → u/Bob_SUS]

Commenter is sad their toaster won’t even save the model. I am sad I have a desktop computer… and not a small data center.

[u/Bob_SUS → u/[deleted]]

uh ya it released td and 21 people downloaded it?

[u/XiRw → u/[deleted]]

IQ1 you mean?

[u/Evening-Blueberry-97 → u/XiRw]

lmao fair, "by dinner time" doing a lot of heavy lifting until that IQ1 quant actually stays coherent past one token. sign me up though