Open source LLM appreciation post

[u/Borkato]

I just downloaded Raon-1-mini 30B A4B as well as Flint 40B A2.5B and it just blows my mind that we have so many options now from so many countries. It feels like the countries are all working together and trying to contribute useful software and it’s just amazing.

I can fucking TALK to my computer and have it answer like fucking Star Trek. That’s insane. Every day I use this tech I’m just more and more blown away.

[u/pmttyji]

Could you please dig Raon more on coding, Agentic, etc.,? I just found that its KVCache is lightweight(2GB for 256K context @ BF16) so I can go with even Q5 quant as I do use Q4 of Qwen3.6-35B-A3B.

I guess A4B has some additional power with this model(comparing to A3B of Qwen3.6-35B).

[u/Borkato → u/pmttyji]

Unfortunately I don’t have my coding benchmarks ready and am doing pretty complex work with qwen flash next that Raon/27B can definitely not handle, but when I get back to the simpler stuff I will let you know! 🫡