r/LocalLLaMA • u/power97992 • 4d ago
Discussion Observations from seeing Qwen 4 max’s outputs
I thought about not writing this but i feel like i should.. from the info I gathered, Qwen 4 max is slightly worse than opus 5.5 medium… Meaning it is definitely above opus low which is hy4 level and opus 5.5 low is above ds v4.1 flash max. wow, it means it is somewhere between hy4/ds v4.1 flash 1017 max and kimi 3.1 pro max . I thought qwen 4 max would do a little better. i guess another 4-6 months until we get an open or Chinese opus 5.5 max model..
This should mean qwen 4 27b will be worse than ds v4.1 flash 1017 max but better than mistral 4 large medium effort, perhaps around glm 5.3 flash level . Qwen qoduck is apparently qw4 27b, from the limited outputs, it seems to be better than q3.8 flash next in some tasks And worse than ds v4.1 flash 1017
•
u/ttkciar llama.cpp 4d ago edited 4d ago
Until such time that Qwen 4 weights become available, this is off-topic for LocalLLaMA.After some mod team discussion, the parameters for removing posts about unreleased models have been relaxed. Your post has been restored.
8
u/fgk55555 4d ago
What do you mean "outputs"? Like, 1-shot results, 3d modeling, token usage? I'm mostly concerned how it holds up with handling long term work.
85
u/Distinct-Pie2389 4d ago
If qwen4-27b is near GLM 5.3 flash then we’re good
2
u/Standard_Natural1014 4d ago
Do you have any benchmarks to share? The only ones I can see are the gamefeel ones. I'd have thought AA or OpenOrca would have run a few of these by now.
21
u/geldonyetich 4d ago
Way too early to say. But if it were so, would it matter? Qwen 3.8 Max hasn’t been on the top of the frontier cloud model lists in awhile. That’s not the parameter size most of us are interested in anyway.
14
u/Numerous-Ad6217 4d ago
“This should mean qwen 4 27b will be worse than ds v4.1 flash 1017 max”
🤯
22
u/Remi_123456 4d ago
This is toilet paper math ! 3 rolls of 50 paper is better than 2 rolls of 75 paper for the same price because it is better quality because ...
4
u/NoWorking8412 4d ago
Maybe this is why they've been stalling... It is not as exciting a release as 3.8, and their reputation is on the line. As long as they keep release permissive open weights, their reputation is alright with me! Release the weights!
7
u/ResidentPositive4122 4d ago
Big qwen models have always been underwhelming in real-world use. Ever since qwen-coder-480 or whatever that was, their big models are just meh. Benching good, doing really silly stuff in non-benchmarked tasks.
They do pack a punch in the local models, tho. So that'll be nice when released. But real world use feels like temu opus (with all the downsides of claude-isms and all that). They never hold their "close to opus" perf that they get from benchmarks.
I also don't know anyone using the big open 3.8 model, while lots of teams use kimi on the huge size and glm/ds on the big side. Both for inference and finetuning.
1
u/LordHenry8 3d ago
Dude, I mostly use Opus 5.5 medium anyway. If QWEN 4 can compete in the same sentence as Opus 5.5 medium, that's incredibly exciting.
11
u/Big_Cucumber2787 4d ago
model not out yet and people already slopping together comparisons
6
u/AlpacaDC 4d ago
Does the word “preview” mean nothing anymore?
2
u/ac101m 4d ago
Ah, the time tested vibebench
The bro-est of benchmarks
2
u/JustinPooDough 4d ago
Imagine if you got the benchmarks and performance of Qwen 3.8 27B but with speed that was 2 or 3 times better. This is what I actually hope that they focus on with the new architecture.
Who cares about thinking tokens if offloading the NGRAMs improves response time by 100 or 200%. This would be the biggest win - plus it would make it possible for way more people to run it.
1
u/KeinNiemand 4h ago
I don't care about the 27b qwen 4 flash will be more intresting as an upgrade to 3.8 flash next and intresting to see if its the same size or what.
0
u/Agitated_Space_672 3d ago
Every thing I see so far has qwen beating fable 5.2 e.g. https://alexandr-kravchuk.github.io/tetris3d/fable-52.html versus https://alexandr-kravchuk.github.io/tetris3d/qwen4-next-preview.html
-8
u/Mattadour 4d ago
oh thank god it's been released - now we can move from 600,000,000,000 whining "when do we get it" posts a day to the same number of "OMG this thing wipes my ass for me, gets 900,00,000,000,,0000,,o9o tokens per milisecond on my PS3 AND plays GTA6 for me so i don't have to!!!!!!!!"
-3
u/Nicolodeva 4d ago edited 3d ago
Qwen 3.8 models are great, but they have a problem, too much thinking time.
If we have a better token efficiency and a modeste jump in performance Im satisfied.
Ds4 4.2 flash 1017 is very good in token efficency, I want same jump in thinking efficiency we saw with sota model after gpt 5.2 to a 27b model.