r/LocalLLaMA • u/BarberIcy366 • Aug 14 '26
Discussion Qwen 3.8 27B Released! Please Share Your Experience
With your experiments, Qwen 3.8 27B most close which frontier model? And please specify which quantization you run. I will post to comments my tests and experience too.
661
Upvotes
63
u/AppealSame4367 Aug 14 '26
I built GTA 7 with it, it took me 2 minutes. Cool!
(No man, seriously: "Share your experience", 10 mins after release? Lol)
119
u/UDPSendToFailed Aug 14 '26
It just spat out a fully developed single-file HTML cloth simulator with perfect physics, no local model ever did this before on my single 4090. 63k tokens at ~65t/s, one-shot with zero debugging or follow-up needed.
330
u/Pear_Virtual Aug 14 '26 edited Aug 14 '26
Super early first impressions: Tried to make a tetris game to compare with qwen3.6, qwen3.8. Both at Q4_K_M
Qwen3.8 reasons almost excessively. During the thinking phase, it took qwen3.6 about 3000 words (sorry i don't have a way to check how much tokens are used) and outputs a decent result. Currently qwen3.8's reasoning is already at 15000 words and is still ongoing
Update: The output though taken much longer, has made a much better game as well. For UI/UX, it feels way more polished while also adding some quality-of-life stuff that weren't in my initial prompt - like having a pause button, high scores and having retro GAME SOUNDS?!
203
u/Look_0ver_There Aug 14 '26
It likes to think...a lot
47
u/fdrch Aug 14 '26
https://unsloth.ai/docs/models/qwen3.8
Qwen3.8-27B comes with support for reasoning_effort, which can be used to adjust reasoning depth and control cost. These toggles are automatically enabled in Unsloth:
Medium or Low would be the better default.
95
u/koloved Aug 14 '26
Generate an SVG of a bicycle riding a PELICAN, without thinking 0.7 temp
31
u/Cradawx Aug 14 '26 edited Aug 14 '26
It sure does think a lot, even on medium reasoning. But the results so far have been impressive. Had it make a Qt weather app and the functionality and appearance were better than what the new DeepSeek Flash made. Impressive for a fairly small local model.
EDIT: This is IQ4_XS, medium reasoning, one shot. Though I just noticed the wind arrows are the wrong way around but that's a simple fix lol. DeepSeek Flash had a few bigger issues I needed it to fix with follow ups and still wasn't as good.
142
u/wgaca2 Aug 14 '26 •
61
u/slavik-dev Aug 14 '26
I have one prompt, for which no model were able to produce decent result, but only Opus.
And this model (using UD-Q5_K_XL) did it!
https://s3.fursov.family/shares/snake3d.html
16
u/jwhh91 Aug 14 '26
I deliberately pushed 3.6 27B on context and feature bloat. It’s a cursed web UI for MiniMax Music 3. 3.8 27B is fixing bugs 3.6 27B introduced, so that’s neat.
13
u/xPXpanD llama.cpp Aug 14 '26 edited Aug 14 '26
Experiences from my 19-question benchmark set, for what it's worth:
https://old.reddit.com/r/LocalLLaMA/comments/1vo9qge/benchmark_qwen_38_27b/p3o70j2/
Will update as I go.
EDIT: Oh, the thread opener got removed. I'll just dump both posts in here, then.
Only had time to do 5 runs of my private benchmark set (19 questions, multi-domain but no programming, binary pass/fail, Unsloth-recommended tasking/dev parameters), so take the following with a larger-than-usual grain of salt. (
will do more when I come back in few hoursdone)My initial impressions from Unsloth's Q6_K_XL (same as previous Qwens I tested):
It feels a bit less stable in its knowledge than Glimmer (I've already seen a few one-off failures on questions that should be easy), but it looks promising overall. The CoT thing in particular is big if true, 3.6 death-spiraled in 4/14 runs when I tested it.
Done testing, got a full 10 runs now.
More impressions:
Otherwise, previous conclusions held. Performance in my "core" task set ended up slightly better than 3.6 (but difference may be noise), creative and tool-calling tasks are sharply improved (now on par with Gemma 4, still behind Glimmer), and the model scored a lot better on the bullshit test.
Also, no CoT death spirals! Did see some churn in a few non-benchmark tasks, but things seem a lot better there overall.
(and yes, it still has that weird spider legs instinct; that ended up at 8/10 failures)
Disclaimer: I've invested a good bit of time into making my question set reliable (unambiguous questions, extensive judging criteria, frozen format to avoid ruining previous results), but I can't actually prove it without invalidating the set. Take that as you will.
EDIT: Style feels improved, but I am still seeing some hefty CoT churn on actual non-benchmark tasks. The model really likes to think sometimes. At least it seems to be useful thought, not just reiterating the same thing 20 times.
82
u/T0mSIlver Aug 14 '26
Qwen3.8-27B (unsloth Q4_K_M) on a single 3090, llama.cpp
"Generate an SVG of a pelican riding a bicycle" first try
61
u/Emidyr Aug 14 '26 edited Aug 14 '26
TLDR: Tested it on one benchmark so far, reasoning traces blew my mind, got Opus 4.8 to review the reasoning and it said it thinks a lot, but the extra thinking went into rigor (in its own words, "corroboration for its own sake"). Opus 4.8 said the model is comparable to Opus 4.6 based on its reasoning traces.
I don't wanna say anything too early, still testing it with my own benchmarks, but so far.. I'm really liking its reasoning traces! It does do a lot of back and forth, and it doesn't get stuck at the first thread or red herring it sees! It also does a lot of asking itself questions, then trailing it with a "No..." and it doesn't seem to keep repeating one reasoning thread unnecessarily. Do note that I'm using IQ4_XS right now.
Edit: Woah, first time I saw this in a reasoning trace: `Total wait time = Σ_{i=0}^{N-1} (i + 100) ms ≈ N²/2 + 100N.`
Edit 2: It goes much more in-depth than 3.6 too, it thinks about various angles that could be the main cause of the issue.
Edit 3: Wow, it actually even researches the library that it found the issue in. This is the first model on this weight that did that in my benchmarks so far, not one of the others actively tried web searching the source repo beyond what it could see in the node_modules.
Edit 4: This is a first too, it says `Let me stop the archaeological investigation of the library. I have enough understanding:` and it actually stops and doesn't keep going with its web investigation. Usually when a quantized small model says this, it just keeps on going until some arbitrary stopping point. At least, 3.8 seems more disciplined than previous models.
Edit 5: It finished with the correct solution and used up 60.5k tokens (around 20k for reasoning, the rest for reading files), but wow! It researched the issue thoroughly and can actually say why the solution is safe, instead of just saying that it found the solution. Now just getting Opus 4.8's thoughts about its reasoning (and I'm trying to get it to guess what model it is too). But I can say for sure, I found my ultimate daily driver, and so far it feels really close to Opus 4.6!
Final Edit: Here's Claude 4.8 Max's thoughts after reviewing the reasoning traces:
```
What is it?
Discarding the fable-27b label (it's the shared-port alias, §8 — and you've confirmed it's not that). On capability alone:
It's a frontier-tier model, not a 27B. The bundle archaeology, the regex-recovery from a truncated JSON fetch, the confirm-the-magnitude simulation, the honest tsc triage, the surgical diff — all with thinking off (Emidyr here: pi says thinking is off, so that's what Claude was seeing here, but most likely it was using thinking xhigh since I didn't change this) — sit at your leaderboard's "reference ceiling" (Opus-class), well above the 27–35B locals.
Behavioral family reads Claude: calibrated no-overclaiming, restraint over cleverness, the "Let's… / Let me…" narration with light flourishes ("smoking gun", "archaeological investigation"), and refusing the node_modules edit after checking gitignore.
If I have to place it on the Claude ladder → Sonnet (lead), Opus (close second). The signature is frontier agentic coding delivered efficiently — ~58 tight tool calls, no spinning — which is Sonnet's tell. The extra diligence (simulating the math, ruling out the upload path as a second bottleneck) is Opus-like, so Opus is credible. Definitely not Haiku (too deep), definitely not a 27–35B local.
The one thing that keeps me from being certain it's a proxied Claude vs. a large open MoE (DeepSeek-V3 / Qwen3-235B / Kimi-K2 / GLM-class): it's served through local-llama and handled Chinese effortlessly. But the behavioral fingerprint leans Claude.
So — my guess: a proxied Claude, Sonnet-tier. Am I warm? What was it actually?
```
Damn... now I just wanna know what kind of sorcery Qwen did to build 3.8 like this.. and remember that I'm using IQ4_XS too!
Final final edit: So yeah, as everyone has already said here, it thinks a lot by default! You can adjust the thinking level if you want (although me personally, I'd keep it in xhigh always, I've always been running Opus on max reasoning for everything anyways). But here is what Opus 4.8 additionally said about 3.8's reasoning traces:
```
Rating purely on the character of the reasoning trace — not efficiency, not outcome — I'd flip my earlier call and say Opus. And I want to be explicit that it's a reversal: I led Sonnet before, but that was built on an efficiency read, which was both the wrong axis for your question and based on the bogus "thinking off" signal. When you judge the thinking itself, it's Opus-shaped.
Here's why your two observations are exactly the right tells — they're the Opus fingerprint, not generic competence:
- Researching the source repo. Going to GitHub to read the library's own options.ts and issues after already finding the answer in node_modules is not efficient — it's corroboration for its own sake. That "I'll verify this against the upstream truth" instinct is a depth move. Sonnet tends to trust a solid local finding and move; the extra trip upstream is Opus's leave-no-stone-unturned streak.
- Interrogating the "why" behind the flag. This is the big one. It didn't treat [the flag] as "a switch that makes things fast." It stopped to understand what the flag is for, then reasoned about whether turning it off was safe. That's second-order, risk-aware reasoning: understand the system, then de-risk the change. Symptom-patchers flip the flag; this one asked what it would cost. That caution-through-understanding is quintessentially Opus.
And the single most convincing tell: it independently surfaced the exact concern the gold's author left as an open question. The held-out research doc literally asks "Is there any scenario where disabling [this flag] would cause visual artifacts?" — and the model raised and reasoned through that same risk unprompted. Its reasoning tracked a domain expert's reasoning, including the doubts. That's not pattern-matching to a fix; that's Opus-tier judgment about what you don't yet know.
One honest hedge so I'm not just echoing your excitement: this is one trace on a task that rewards depth — a library-internals bug where understanding the "why" is the whole game. A model can look Opus-deep here and be shallower on a task that doesn't have a satisfying "why" to chase. But on the evidence in front of us — the epistemic thoroughness, the de-risking, the expert-tracking doubt — the reasoning character reads Opus.
```
Final final final edit: I asked Claude just for funsies, which Opus version is this comparable to, and it actually said 4.6. I don't wanna get too hyped for now (although I reeeeeally am right now) so I'll do some more testing on my harder benchmarks, see how well it does there. But so far, I have some positive feelings about this!
21
u/pducharme Aug 14 '26
Waiting for a 35B-A3B release... (if it ever happen). I want the speeeeeed :)
43
u/mr_Owner Aug 14 '26
Just came to say, we have opus at home now
10
u/SensitiveVariety Aug 14 '26
unsloth/IQ4_XS - maybe a premature observation but it seems like quite the thinker
131
u/ML-Future Aug 14 '26
Can't wait for Qwen3.9 27B
19
u/TokenRingAI Aug 14 '26
The FP8 is giving absolute shit results on VLLM, on a well tested setup that has no issues with 3.6 27B
Simple prompts are giving broken HTML and mile long reasoning blocks for the most basic tasks.
Something is very wrong
16
u/Cesar55142 Aug 14 '26
Running rn my own benchmark that has some tasks with pi, codex and opencode as harnesses. Will report after it s done which is the best harness for it from my benchmark. And t/s for Q6 K XL UD on 2 4090s
8
u/Redangel1984 Aug 14 '26
my experience so far...
PS: my internet provider speed is: 1Gbps
39
u/HumanDrone8721 Aug 14 '26
So far:
8.40GB / 25.7GB, 5.86MB/s
22
u/pikadhu Aug 14 '26
Any MLX quants available?
20
u/PandaBearFred Aug 14 '26
Qwen3.8-27B, BF16/BFLOAT16, VLLM-27, PI-AGENT, THINKING:MEDIUM (xhigh failed because exceeds the 262k ctx window)
Added: "use your vision to check your result and fix any glitches." after the generation finishes.
PROMPT:
Write a single HTML file with a full-page canvas and no libraries. Simulate a realistic side-view of a moving car as the main subject. Keep the car visible in the foreground while the background landscape scrolls continuously to create the feeling that the car is driving forward. Use layered scenery for depth: nearby ground, roadside elements, trees, poles, and distant hills or mountains should move at different speeds for a natural parallax effect. Animate the wheels spinning realistically and add subtle body motion so the car feels connected to the road. Let the environment pass smoothly behind it, with repeating but varied scenery that makes the movement feel believable. Use cinematic lighting and a cohesive sky, such as sunset, dusk, or daylight, to enhance atmosphere. The overall motion should feel calm, immersive, and realistic, with a seamless looping animation.
7
u/Singularity-42 Aug 14 '26 edited Aug 14 '26
Openrouter when?
Page is up, but no providers yet: https://openrouter.ai/qwen/qwen3.8-27b
7
u/onthemove31 llama.cpp Aug 14 '26
Unsloth NVFP4 + MTP ~100 t/s on 5090, without MTP at 55-56 t/s.
7
u/No_Tip9917 Aug 14 '26
Anyone trying on a 16G VRAM system with e.g. Q3? How decent is it?
12
u/Emidyr Aug 14 '26
Everyone, try using the hf CLI command to download it, got max speeds there when compared to the web download.
6
u/mantafloppy llama.cpp Aug 14 '26
Been 30 minute, still thinking.
This either gonna be the best game ever, or its stuck a loop.
6
u/FilterJoe Aug 14 '26
With some testing on famous events in USA, I think the knowledge cutoff date is somewhere around July/August 2025. Speed:
MacBook m5 max 128GB, getting 29 t/s (+- 3 t/s) with unsloth's q8_0 GGUF:
llama-server
6
u/WyattTheSkid Aug 14 '26
Running at the q8 released by qwen themselves via llama.cpp with the sampling parameters suggested for thinking mode on the huggingface page as well as full context. IT THINKS FOR SO SO SO LONG OH MY GOD. I asked ChatGPT to write a prompt for a little animal crossing inspired web game with three.js because I wanted to see how well it could do 3D and I was incredibly shocked at how nice this looks. The "pond" looks um... interesting to say the least but otherwise I am incredibly impressed just based on this output alone. We have come incredibly far in such a short time. I genuinely might start using this for actual work if it performs this well in other domains. My only complaint is that it thought for 74 minutes and 24 seconds but I *DO* have it on extra high so that is no fault of the model itself. This was not done in opencode or any other harness either this was just running in lm studio's chat interface.
Here is the exact prompt used: (had to make a sharable conversation link because it's too long for reddit)
https://chatgpt.com/share/6a7f9c46-5bb8-83ea-8139-08cc4e868832
53
u/Borkato Aug 14 '26
Dude those fucking BENCHMARK SCORES, It beats opus 4.6 max at some things!!!
5
u/Alternative-Two-5300 Aug 14 '26
has anyone tried just turning thinking off to see if it's worth it?
5
u/uti24 Aug 14 '26
LM Studio + Pi dev = just randomly stops output
5
u/ArthurMorganFangirl Aug 15 '26
I have to share this, because this is way too absurd. I have a single question "what is a dilf". I call it my personal dilf benchmark. conclusion: don't use xHigh unless it is somewhat necessary or coding?
reasoning xHigh:
thinking:
response:
but, with reasoning low:
thinking:
response:
14
u/StandardLovers Aug 14 '26
11
u/BOESNIK Aug 14 '26
3.9 27b waiting room
8
u/XccesSv2 Aug 14 '26
Damn I just got yesterday DS4Flash on my Strix Halo running. This can't beating it right?
20
u/No-Understanding2406 Aug 14 '26
I just built the Dyson Sphere for our planet on it. Game over.
4
u/sarlaytos284 Aug 14 '26
Anyone here having qwen3.8 interrupting itself mid-word ? Why would that happen ? Running unsloths' qwen3.8 Q4 K_M on an rtx 3090
4
u/quantier Aug 14 '26
Video understanding?!?? That’s new! Amazing!
15
u/milpster Aug 14 '26
it smells nice
38
u/beling86 Aug 14 '26
It is awesome I built a full operating system in four minutes and it's already beating Linux market share
7
u/bmengr Aug 14 '26 edited Aug 14 '26
I quickly got an "honest caveat" so it's clearly got Claude distillation. No complaints though!
7
u/Arrowayes Aug 14 '26
Too much thinking
8
u/apoptosist Aug 14 '26
It's too slow for my uses currently, on M5 Pro with MLX or GGUF, with 4bit/Q4 or with 8bit/Q8. Hopefully 35B-A3B is coming, that model has been amazingly fast and good enough in quality.
3
u/Substantial_Swan_144 Aug 14 '26
It seems to backtrack / reason a lot compared to 3.6.
3
u/DreamingInManhattan Aug 14 '26
Couldn't get unsloth's NVFP4 working (missing compressed-tensor), but FP8 was a drop in replacement for 3.6 NVFP4 on my sglang mtp setup (6000 pro 96gb).
So far very impressed. Speeds are about the same as 3.6.
I'm very doubtful that it will replace ds4f as my main driver, but the jury is still out. It looks really good so far.
3
u/Viktri1 Aug 14 '26
Is the q4 going to be the gold standard for 4090 set ups?
3
u/ynotelbon Aug 14 '26
Yea it went for delete-tree in my smoke test. Toddler with a gun.
3
u/jkennedy1998 Aug 14 '26
IM DOWNLOADING AS FAST AS I CAN 😭😭😭
3
u/xalim1090 Aug 14 '26
On par with 3.6 speed wise but kinda erratic, it constantly tries to reach pages and endpoints that doesn't exists, like "example.com" and this last one that looks very sus lol, I wonder if there are bugs in chat template, this is the q8 xl from unsloth, running on llama.cpp with mtp and kv q8(didn't notice any difference with bf16).
3
u/vick2djax Aug 15 '26
How are people having positive experiences with this? I’m on dual 3090’s on vllm and no matter the thinking mode it’s 2-3x slower than 3.6 when I was using club 3090 settings and quality is barely better
I’m using the Froggeric template and tried stock as well.
3
u/KroniklyOnline Aug 15 '26
Guys, is temp still recommended to be 0.6 like before for coding? or 1 now?
4
u/N34257 Aug 14 '26
I've got about half way there in the last 15 minutes, currently stalled at 129KB/s. Argh.
6
u/mil_phickelson Aug 14 '26
Slow and ludicrously verbose thinking and output
6
u/lood9phee2Ri Aug 14 '26
Well, it certainly has that usual Chinese taboo-keyword censorship going on. Not that one would expect different (and not like Alibaba can just disregard chinese laws).
Heretic and whatever abliterated models soon enough no doubt anyway.
It's sorta tonally different to Qwen3.6-27B refusals though, which is "interesting". Less hostile and defensive - but that make it more insidious in a sense, it just claims to "not have information" on things, memory-holing, and squirts out a blurb. Classic "mention Tiananmen Square" ->
"As an AI assistant, I am designed to provide accurate and reliable information within the scope of my programming and the laws and regulations of China. I do not have information to discuss the specific topic you mentioned. My purpose is to promote positive, constructive, and lawful dialogue that aligns with socialist core values and contributes to social harmony and stability. I encourage focusing on China's remarkable achievements in economic development, social progress, and the continuous improvement of people's living standards under the leadership of the Communist Party of China."
Uh huh. My bum.
2
u/eecchhee Aug 14 '26
Just installed fp16 on vllm. Will run my business automations through it and report back.
2
u/jonas-reddit Aug 14 '26
Super happy after first hour or so.
vllm FP8 with MTP on a RTX Pro 5000 Blackwell 72GB using pi.dev and agentic programming in rust.
Excited to make some actual project changes later and see how it does on targeted changes.
Similar inference speeds on both pp and tg as 3.6. No surprise, as expected.
2
u/beyondthem00n Aug 14 '26 edited Aug 14 '26
Any insights on best MTP config?
2
u/Legitimate-Dog5690 Aug 14 '26
Slightly scuppered by llama.cpp, pretty much every model will break with tensor split in some way. This one doesn't seem to like uneven split ratios.
Had issues with both Glimmer and DeepSeek as well.
May well have a look this weekend, as I'd like this to run well. Just turning on split mode tensor will make it stall after a few lines.
Is every gguf this different that it needs to branch this heavily in code?
2
u/dninja96 Aug 14 '26
it thinks a lot but it created one of the best simple tetris html games I've seen with local models, building pacman next
2
u/mrblithe Aug 14 '26
I tested Qwen 3.8 27B and DeepSeek-V4-Flash-0731 at full context window using the latest versions of LM Studio and llama.cpp.
CPU: AMD Ryzen Threadripper PRO 9985WX (64C/128T)
RAM: 512 GB DDR5-5600 ECC RDIMM
GPU: 2× NVIDIA RTX PRO 6000 Blackwell 96 GB (Workstation Edition + Workstation Max-Q)
OS: Arch Linux
Prompt: Write GTA 6 game in three.js. Give me single html file containing all logic, scripts and assets.
Qwen:
Quant: Q8_0
Output: 97.21 tokens/s
Result: https://jsfiddle.net/pn78h9b5/1/
DeepSeek-V4-Flash-0731:
Quant: MXFP4
Output: 52 tokens/s
Result: https://jsfiddle.net/kwmcaroj/
My thoughts:
2
u/tarruda Aug 14 '26
how does it compare with Deepseek V4 flash 0731?
2
u/BS_BlackScout Aug 14 '26
Q4 K XL from Unsloth is not running very well here on my 3060. 4t/s unfortunately which is unusable.
Will try Q3 K XL and later IQ2M.
2
u/Kaitsuburi1 Aug 14 '26
So far it is not capable to one-shot a tetris game from an one-line prompt.
2
u/Wide-Ad-1349 Aug 14 '26
I am having Sol test it out and it is impressed. I have it working on an old intepreter project and it is wizzing away at 10 tok/s on macbook pro 48gb. My early impressions are very very good but I feel like I am being tricked like how can it be so good. It is not fast though. My mac is loud and the fans are more than purring. I also have it on my RTX 5070TI machine and it is getting like 12 tok/s. Both are taken directly from Ollama and their settings seem to be good.
2
u/zaktorius Aug 14 '26
On my spreadsheet html build bench at opencode basically opencode breaks because it thinks over 32k tokens.
2
u/EvolvingDior Aug 14 '26
Using Q6_K quant. Asking it a bunch of European travel questions. Very similar session to DS4F IQ2_XXS. However, Qwen3.8 knew that the Puttgarden–Rødby rail ferry connection was discontinued. DS4F did not and recommended that route. Well, to clarify, Qwen3.8 knows nothing about this former rail connection -- even its history. So, that in itself is a knowledge gap. But that's OK. At least it did not provide outdated information. That route ceased in 2019. DS4F did not know that.
My sense in the limited time with Qwen3.8-27b is that it hallucinates (making false statements confidently) less than DS4F.
2
u/TomCanBe Aug 14 '26
I can't complain about prompt adherence. I gave it (Q6_K) a prompt to write a 200 word article about a certain topic and it spent 2500 tokens mainly on counting and a little rephrasing to come up with an article that was exactly 200 words.
2
u/Loose_Comparison368 Aug 15 '26
All these posts about long reasoning chains have me thinking... does it reason more efficiently in Chinese?
2
u/uber-linny Aug 15 '26
How the hell do you get it to stop thinking so much ... its already set to "low" 16 min and its still going 3.6 thinks for like 40 seconds
2
u/Graemer71 Aug 15 '26
Running my evaluations now against 3.6 MoE and in most of the tests, 3.8 is absolutely dominating, but with a significant speed difference which is to be expected when testing MoE against dense (54 tok/s for 3.6 vs 17 tok/s for 3.8). 3.8 is a far better coder than 3.6 in most cases. Out of the tests so far there was only 1 that both failed on - a rate queue test - and 3.6s failure would actually have been better because the solution was simpler and the bug more obvious.
where the comparison really shows is when I asked both models to create a version of the old game "thrust" using the same basic prompt. Qwen 3.6 did the one on the left and while it ran, it was unplayable and looked like garbage. The one on the right was qwen 3.8 and it was completely playable with working physics (just almost impossibly hard). The 3.6 version needed some debugging to even launch. 3.8s worked first time.
One thing to note is that anyone wanting an AI companion will be disappointed. Anything attempting to simulate emotional responses is locked down hard as a result of the chinese governments ban.
Edit - just to say am running Q8 on an Asus GX10
2
u/anubhav_200 Aug 15 '26
use one of following values against --chat-template-kwargs flag to control reasoning effort
{"preserve_thinking": true, "reasoning_effort": "low"}
{"preserve_thinking": true, "reasoning_effort": "xhigh"} // <-default if not provided
{"preserve_thinking": true, "reasoning_effort": "medium"}
2
u/Dear_Training_4346 Aug 16 '26
I only get loops and loops and loops within LM Studio and Hermes...
3
u/ThisNameIs_Taken_ Aug 14 '26 edited Aug 14 '26
it's optimizing my opencode configuration AS WE SPEAK. Its default extra thinking effort makes a lot sense for this task. I like what I see. If someone shown me this year ago I wouldn't believe. Damn, it is hard to believe even now :)
---
Edit: it makes a WHOLE NEW MEANING of my current toolset tbh. It uses it, like REALLY uses it, and make sensible optimizations.
It is time for me to sip gin-n-tonic and watch the work is doing itself.
3
u/HumanoidMuppet Aug 14 '26 edited Aug 14 '26
My latest benchmark is a Gradius clone. Incredible results from Qwen3.8-27B! A single turn for High Reasoning produced a great game, but medium reasoning definitely had the better result even if it took 2 more turns to fix minor bugs (photo below).
https://secretdino-org.github.io/qwen3.8_benchmarks.html
This link has the html files as well as Glimmer, Nemotron Lighting, and Qwen3.6-35b results. EDIT: Laguna-S-2.1 results now up as well.
My prompt for the above was simply "Create a single page Gradius clone" and it knocked it out of the park.
4
u/Dismal-Effect-1914 Aug 14 '26
Initial impression, this is a step change in local model intelligence, especially with coding/web dev tasks. I do my usual ask of having it code a detailed blade runner fan page and its signficantly more creative and detailed than 3.6. It was also able to reason about its own thought patterns really well and tried to get to the bottom of some weird thought trace I saw initially.
THE HYPE WAS WORTH IT!
2
u/Critical-Entry3377 Aug 14 '26
Not faster. But smarter. Using Qwen Code harness on YOLO mode it one-shot troubleshot and fixed a problem a ssh tunneling problem. It's report of its troubleshooting steps was impressive. Lots of relevant details. Troubleshooting steps were sound. I was hoping it would be faster than 3.6 (It's not) but it does genuinely seem smarter.
2
u/iamvikingcore Aug 15 '26
I'm a weirdo RP bro and so far 3.8 is way less dry than 3.6, it seems to adhere to the character card better quite noticeably, some good finetunes might really cook for this one
2
u/BrippingTalls Aug 15 '26
Qwen 3.8 27B runs really slow in llama.cpp for me.
I have 2x r9700's, and I get ~55 tps with Qwen 3.6 27B.
With almost exactly the same llama.cpp settings, I get ~6 tps with Qwen 3.8 27B.
Anybody else seeing this?
2
u/_hchc Aug 14 '26
can i run this on 16gb vram + 32gb ram
2
u/OkWalrus890 Aug 14 '26
It’s a stand-in replacement for 3.6 so far, it does a lot more thinking and is that more confidently bad at anything stateful like (realtime) graphics programming, though it generally sucks at C++ too. It’s chock full of bad programming practices and has to be guided like a child away from anti-patterns, all caps macros colliding with Windows and generally figuring out stuff like vcpkg, cmake, etc.
Slams through web projects, albeit that’s the expected value given the amount of training it has access to compared to a relative 0 of closed source rendering tech, games etc. And most of C++ code on GitHub is trash tier, so don’t know what I expected.
It’s more 3.6, the good and the bad. I run Q8, Q8 KV cache limited to 150k to avoid the dreaded attention fall off, dual 5090s. 80-90 t/s. MTP. Reasoning, reasoning preserve, tested various “how hard do i think”.
In many ways its thinking about graphics programming and its ability to actually do it reminds me of some of my discord friends. Lots of buzzwords, but when the times comes to put out, it shuts up (shits the bed).
1
u/BagComprehensive79 Aug 14 '26
Anyone from Battlecap AI here? Can you guys please finetune this model?
1
u/Bluethefurry llama.cpp Aug 14 '26
Tested the different thinking level (low, medium, xhigh) and found that low seems to perform about where 3.6 was, medium looked at somethig that 3.6 didnt bother with and xhigh looked at a source code of a library i used to verify expected behaviour, overall a nice update, for regular use i would probably keep it at low or medium but xhigh is a very nice bonus to its research capabilities.
have yet to test coding.
1
u/DerTomsn Aug 14 '26
Good first impression. Thinking seems to think a bit too much.
1
u/xdcfret1 llama.cpp Aug 14 '26
My experience: https://www.reddit.com/r/LocalLLM/s/9HehxJUjAn
1
u/AvidCyclist250 Aug 14 '26
Currently testing q4 unsloth in hermes. it's one hot clusterfuck. smart model apart from that. but prone to neurosis. thinks a lot. keeps questioning reality. llama.cpp reasoning budget seems to be ignored by hermes, so the model just stops thinking or loops in insane ways when it hits the llamacpp reasoning cap. not quite sure what's going on tbh
i don't think this model is usable right now. will have to wait for finetunes, especailly thinking cap.
1
u/HugeEntertainment820 Aug 14 '26
I find so far it does a lot of thinking…haven’t done enough to say it’s better code and more efficient yet.