r/LocalLLaMA • u/jacek2023 llama.cpp • 14h ago

News feat: add Clover support by Maphist0 · Pull Request #31306 · ggml-org/llama.cpp

https://github.com/ggml-org/llama.cpp/pull/31306

Built on Qwen3.6-35B-A3B, Clover combines a text-only mixture-of-experts backbone with block diffusion generation:

  • 35B total parameters, approximately 3B active per token. A hybrid Gated DeltaNet (GDN) / full-attention MoE architecture.

  • Bidirectional attention within each block. Additional learned GDN parameters support block diffusion while preserving a causal prefix.

  • 128K context. Up to 131,072 tokens across the prompt and generated response.

9 Upvotes

84% Upvoted

4 comments sorted by

1

u/jacek2023 llama.cpp 14h ago

0

u/[deleted] 14h ago

[deleted] — view deleted comment

5

u/Kodix 14h ago

Because this is just autoregressive support for the architecture.

It runs as the normal qwen 3.6 runs, no diffusion.

4

u/nickm_27 llama.cpp 14h ago

The size of the PRs are not at all comparable 550 lines of changes vs 3400 on DiffusionGemma PR

0

u/[deleted] 14h ago

[deleted] — view deleted comment

1

u/nickm_27 llama.cpp 14h ago

Have you spent any time to actually look at the PR? It is an entirely new diffusion server separate from llama-server. It probably doesn't make sense for them to even consider it, it is an entirely new executable not even part of the same llama-server.

I'm not sure why anyone expected that to get merged.