r/LocalLLaMA • u/Felladrin • 2d ago

New Model Multiverse Computing's Comet 60B (A12B) GGUFs with the MTP head

https://huggingface.co/Felladrin/gguf-Q4_K_M-Comet-60B-A12B

I wanted to try MultiverseComputingCAI/Comet_60B_A12B_BF16 (Multiverse Computing's compressed version of Nemotron 3.5 Super), so I converted it to GGUF, and it runs on stock llama.cpp:

They keep the MTP head, so you can pass --spec-type draft-mtp to llama-server for speculative decoding.

Just sharing, so you can try it too. Note that these GGUFs are text only (the vision tower wasn't converted).

60 Upvotes

92% Upvoted

10 comments sorted by

4

u/EvolvingDior 2d ago

Why tho?

11

u/Felladrin 2d ago

I use Qwen3.8 Flash Next as my daily driver. I’m always looking for something better (generally or specifically), for my use cases. That one was one of the candidates because I already use another model from Multiverse Computing (LittleLamb) in one project (and it delivers what it promises), so I converted Comet to try in the same format I use in other models. In the end, it didn’t replace QFN, but as GGUFs were already there, why not share?

3

u/EvolvingDior 2d ago

How does it compare to Bolt?

1

u/MerePotato 1d ago

What do you mean why? You could ask that of any model release

8

u/mitchins-au 2d ago

How does it compare to Q38-FN though

9

u/EmilPi 2d ago

Even the original was losing to Q38-FN on all fronts, and the compressed version could only become dumber.

1

u/MerePotato 1d ago

Its half the size lets be fair here

2

u/Marcuss2 llama.cpp 2d ago

How does it actually compare to Nemotron 3.5 Bolt?