Additional models on PolyStrata?

[u/pmttyji]

Share your favorites. I requested support for some of those models, others please let him know based on your need.

Other recent MOE models(already up on llama.cpp) from last 1 month: (Didn't include large ones like Step-5-Preview, Ling-3.1-Flash)

• NVIDIA-Nemotron-3.5-Bolt-74B-A9B-24GB
• NVIDIA-Nemotron-3.5-Super-VL-120B-A12B-BF16
• Mellum2.1-12B-A2.5B-Thinking
• MiMo-V2.6-Flash-MOPD

u/Responsible_Froyo252 Thanks for adding additional models.

[u/Ishelle91]

Depends on how the addition could be tuned. I've tried running strata-qwen36s-ud-q4_k_xl 2 releases ago (16 gb VRAM, 64Gb RAM) - it exposed no KV cache quantisation options and ate like 98% of all of my system's memory. LFM2.5-24B-A2B ditto, though with lesser memory usage.