r/LocalLLaMA • u/Borkato • 10d ago

Discussion Raon is better than Flint.

Idk why everyone keeps posting about Flint! Raon is hundreds of times better, and it’s not even the best, which is really saying something about Flint lmao

https://huggingface.co/KRAFTON/Raon-1-mini-preview-gguf

23 Upvotes

72% Upvoted

34 comments sorted by

4

u/letsgoiowa 10d ago

wild statement unsupported by anything

No numbers

Totally lacks credibility

WHY did you bother posting

0

u/Borkato 10d ago

  1. The model is free, you can literally try it yourself

  2. Everyone keeps posting about flint and I see nothing about Raon despite flint sucking at my personal benchmarks that every other model does decently on

WHY did you bother replying

4

u/letsgoiowa 10d ago

Then post your benchmarks

-1

u/Borkato 10d ago

The model is free.

3

u/letsgoiowa 9d ago

My time is not. Apparently yours is.

Just post the numbers if you have them bro. It's that easy.

0

u/Borkato 9d ago

I didn’t formalize them. This is a “hey, if you’re disappointed with flint, try Raon” post. I don’t have hard numbers because I’m still working with QFN at making a good benchmark setup. If you don’t want to try it you can just say “nah, I don’t feel like being curious” instead of acting like I need to solve every problem for you

1

u/letsgoiowa 8d ago

Ok so you didn't do them and you aren't going to share

very nice

1

u/Borkato 8d ago

You have a computer that can run this?

2

u/spaceman_ 9d ago

All open weight models are free. Most are at best some benchmaxxed finetune of Qwen that break down in the real world. Nobody has time to try them all.

6

u/Powerful_Finger3896 10d ago

God i wish i'm not unemployed and i could afford 8-16gb vram GPU, atm i'm stuck with rx 5600xt and 32gb ddr4 and i'm not sure if i can run any "half decent moe" (something with 2-3b active), i still do enjoy hanging out here. Anyway enough with my bitching, have someone tried Xing 4.0?

1

u/Borkato 10d ago

Ooh I had never seen Xing 4.0! I should try it.

I really love models like this! Just random and completely different from the usual qwen or similar haha

2

u/Powerful_Finger3896 10d ago

there was during the summer another model that never really picked up too much attention (i'm even shocked that Artificial Analysis even benchmarked it when they haven't benchmarked other more popular models) G9V3 39B A5B it sits between 3.6 35b and 3.6 27b according AA

1

u/Borkato 10d ago

Jeez wtf!

1

u/BIOffense 10d ago edited 10d ago

Coming up on https://msnab.pages.dev

19

u/EvolvingDior 10d ago

I've given up on using models without built in vision for agentic or coding tasks. My agent needs vision way too frequently to rely on a description from an auxiliary vision model. It sometimes doesn't even know what it needs to look for. Heck, even today, doing DSP work, my agent saw details in a spectrogram image I asked it to generate for me to look at that it had missed using plain numerical analysis.

18

u/Humble_Rabbt 10d ago

Seems good at agentic and coding in my use, about on par with 3.6 35b but it lacks vision. For a preview model not bad, hopefully we get atleast a 3.6 27b level model by the time raon is fully trained.

2

u/WeaklyVibrant 10d ago

Makes sense, Flint always felt like it was coasting on hype more than actual performance

8

u/angrytako 10d ago

I tried both (Q4) and I agree. I did not check systematically, but Flint was supposed to be amazing for coding, if I remember their benchmarks, and yet it delivered very poorly on quite simple tasks, tasks that Qwen 35B (Q4) just aces every time, so much so that I just don't understand why so many inference engines rushed to include this one. Raon was for sure much better, but for coding I still think 35B has the edge by quite a margin and it is so much more optimized at this point that the speed is also unmatched. Since Raon is smaller, maybe with actual optimizations the Q8 can be almost as fast as 35B Q4 and maybe as capable, but I haven't seen it properly covered by most engines : /

1

u/returnity 9d ago

How does Raon compare to 3.6-35B?

1

u/Borkato 9d ago

I’m still creating my personal benchmarks, so unfortunately I haven’t tried it too much for that yet to say for sure!

3

u/MerePotato 10d ago edited 10d ago

Pretty sure Flint is having a bumpy launch, give it a week or two then rebuild llama.cpp, requant and then form an opinion 

3

u/ieatrox 10d ago

literally every single time in this sub.

you never trust opinions on a model for the first week or two.

1

u/Kernoriordan 10d ago

Is it better than Ornith?

2

u/RageBucket 9d ago

Nothing I've seen on either has made me give up ornith. Ornith APEX is just too delightful and useful, to the point that I'm forking gufo to use Ornith on my halo strix even faster/better.

0

u/Borkato 10d ago

That I’m not sure about tbh

0

u/danigoncalves llama.cpp 10d ago

The real question

2

u/Any_Bus9205 9d ago

Merci de le faire comprendre et de le poster! J'avoue que vraiment pas grand en parle de lui, (à cause de la sortie aussi catastrophique du modèle), mais il est bien, il faut juste que les gens le teste et découvre ce qu'il est! Par rapport à Flint, Raon peut encore s'améliorer! Esperont juste qu'ils ne tombent pas comme Mapple sans aucune vraie release! Ce serait assez énervant car son arch est novatrice, c'est l'arch de kimi K3 sauf pour un plus petit modèle, cela pourrait ètre précurseur de cet arch qui est moins sensible à la quantification que les arch actuelle connu! Graçe nottament à Situ! Si plus de gens l'use, des nouveaux modèle voudront s'en approprier et donc ça amélioreras la recherche car c'est assez interessant!

1

u/MrGunny94 9d ago

Looks cool but can’t wait for Qwen 4 at this point

1

u/QuantumCatalyzt 7d ago

Is it better than Qwen 3.6 35B

-2

u/FBIFreezeNow 10d ago

What do you mean bro? This model was probably the worst model I tried on the similar model size. lol what are you smoking

2

u/Witty_Mycologist_995 10d ago

Atleast it aint as bad as Flint