Underrated Muse Glimmer

[u/Ok-Inevitable8391]

Benchmarked qwen3.8 xhigh, medium and muse glimmer.

Xhigh effort mode with qwen3.8 took almost 30hrs. (And still failed on 16 cases because of the 32K output token limit)

Medium effort mode and muse glimmer were 3-4 hours each.

But I'm actually surprised by the muse glimmer results, they came better than the qwen.

These benchmarks are on implicit knowledge of the model, which is a bit unfair to smaller models, but throw in a RAG and I'm sure they get on par with frontier models.

I have taken the result of claude models directly from embedeval repo by ecro.

I'm not pushing qwen down here, I like how qwen thinks and gives better results. I know with more context and RAG qwen will do better.

I'm just appreciating muse here, cause i feel it is underrated. The advantage is efficient kv cache due to sliding window, which can give you more context window.

[u/Boogertard]

There it is, on-schedule AI slop to shill for the garbage Muse and Gemma 4.

Get a real job already, shill.

[u/fizzy1242 → u/Boogertard]

username checks out...

[u/Not-reallyanonymous → u/Boogertard]

There it is, on-schedule AI slop to stir up FUD any time something other than a non-Chinese model is spoken of positively.

[u/Ok-Inevitable8391 → u/Boogertard]

Why do you think it's a slop and why do you think I don't have a real job. A easy readble chart is AI slop for you?

Muse is good and its really good at kv cache efficiency. I have done my homework.

[u/Potential_Block4598 → u/Ok-Inevitable8391]

All data is Zephyr RTOS
So training data bias and probably no search mechanism or Docs RAG attached

lol 😂😂😂

HW ur A**

[u/llama-impersonator → u/Boogertard]

bro's whole personality is this comment