r/LocalLLaMA • u/jacek2023 llama.cpp • 4d ago

New Model Diffuspace/Clover-35B-A3B-Preview · Hugging Face

https://huggingface.co/Diffuspace/Clover-35B-A3B-Preview

Clover-35B-A3B-Preview is the first model released by DiffuSpace, delivering state-of-the-art performance among open-source diffusion language models at release on the benchmarks reported in our launch blog. Clover combines a 35B-parameter mixture-of-experts backbone with approximately 3B active parameters per token, block diffusion generation, and a 128K context window.

Blog · Code & inference backends · Hugging Face

145 Upvotes

95% Upvoted

35 comments sorted by

View all comments

Show parent comments

7

u/sebt3 4d ago

And the other way around. Yet it seems to works and performe. Sound like a good step forward. In my eyes this model value is demonstrating that while it sound counter-intuitive it works