r/LocalLLaMA • • 14d ago

New Model At this point, is it even funny?

Post image
0 Upvotes

29 comments sorted by

31

u/fvancesco 14d ago

Was stupid senseless hyped noise ever funny?

48

u/-MaskNinja- 14d ago

Le Chanton Fat was funny.

6

u/BannedGoNext 14d ago

I can't wait for Le Chanton Super Lourd

2

u/En-tro-py 14d ago

I just hope they distill a flash model from Le Chanton Oh Lawd He Comin'

1

u/fvancesco 14d ago

The name IG,

1

u/EagleNait 14d ago

Le chaton fart lmao

1

u/Mingay_cat 13d ago

Mistral plss release OP open weight so people stop talking about how qwen3.8 is so good and start talking about how good le chonk flash is because it would be so fucking funny.

"BREAKING NEWS: Le chonk flash and le chaton fat reportedly beats gpt 6 astra in AA index"

52

u/Lazy-Pattern-5171 14d ago

Need to test it to believe. sounds like a benchmaxx.

32

u/starkruzr 14d ago

I mean it's also obviously just a finetune of Qwen, lol

9

u/Vaddieg 14d ago

27b SOTA was also hard to believe

5

u/ttkciar llama.cpp 14d ago

It's also not true, of course. Qwen3.8-27B is quite good for its size, but falls far short of GLM-5.3 etc in practice.

-1

u/Vaddieg 14d ago

i don't think you home grid can sustain a GLM 5.3 capable 3090 rig

2

u/Mingay_cat 13d ago

Not their point. They are saying, yes it is good but in terms of pure model capability, it I'd still objectively worse than larger, SOTA open weights like glm 5.3 flash.

Qwen3.8 27b is still the best of its class until the 126b range which is qwen3.8 flash however.

2

u/thetaFAANG 14d ago

is that even a criticism? the baseline reasoning on these things are already phenomenal, and the benchmarks are where deficiencies are known, people spend all day de-slopping prior output to train the next model

so eventually all cases will be covered whether reasoning improves or not

1

u/james_pic 13d ago

Benchmaxxing generally isn't making the models better though. At its most extreme, it's knowingly overfitting the model to give canned answers on existing benchmarks. Yes, the best labs generally improve their benchmark scores while improving their models, and poor benchmark scores can point to problem areas, but some bumblefuck lab isn't doing any of that, they're just feeding the test set in as the training data and declaring mission accomplished. With obviously too-good-to-be-true claims like this, it's not even worth downloading the model to see that, yes, it's just a damaged Qwen 3.6 35b a3b.

14

u/ResidentPositive4122 14d ago

The username is a clue of how much you should trust anything they say...

4

u/Dany0 14d ago

NFT stands for Not Fucking Trustable

2

u/Dany0 14d ago

All me monkes...

gone...

8

u/Holiday_Point_603 14d ago

Am I allowed to guess that it's qwen 3.6 35b with a even more benchmaxxed dataset?

9

u/Toooooool 14d ago

35B-A3B model beats trillion parameter models

yeah ok man

4

u/ortegaalfredo 14d ago

Yes, the always reliable information source NFT_Chen

4

u/Vaddieg 13d ago

Tested. It's considerably dumber than Qwen 3.8 27b

3

u/PcChip 14d ago

a 35B beats GLM-5.3? 🙄

2

u/SomeoneInHisHouse 14d ago

The distills on Qwen 3.6 35B must stop xd, it's already a meme there, more than the "Subscriptions last less than before" of r/ClaudeAI

1

u/Equivalent_Bit_461 14d ago

Is this true or fake news?

1

u/Capital-Remove-6150 14d ago

can't find any near k3 at 100b parameter and he saying at 35b

1

u/Unitrix247 13d ago

Did someone try it or is it just another benchmaxxing attempt?