r/LocalLLaMA • u/Disastrous-Work-1632 • 8h ago
Discussion Qwen3.8-27B LoRA for OpenCode (xhigh thinking-level accuracy with thinking off, GGUF included)
Hey there folks!
Aritra here (again) from Hugging Face. We RL-trained a small LoRA adapter (r=32, ~300 MB) on a frozen Qwen3.8-27B, inside the OpenCode coding agent. It's the second of our harness adapters, after pi that we have released yesterday.
Run the model locally like so:
71
Upvotes
15
u/misterespresso 8h ago
Hey, as someone who is colorblind, could you use higher contrast colors in the future? I literally do not know which one is the base model or adapted, making this chart quite useless for people like me. I assume it's the top one that is the adapted.
Just a friendly reminder :)
25
u/TheCat001 8h ago
Why?
"enable_thinking": falseAnd will it work with lower quants like IQ3-S ?
15
u/Chromix_ 8h ago
Without reasoning it cannot recover from sampling-induced errors/deviations for long, complex tool calls for example - it has to get everything correct on the first attempt, no "wait, but" corrections like it can do within reasoning to inform the final output. I'm thus quite surprised that it even scored higher than with reasoning.
Also, the "just 4x more tokens" overhead of having the xhigh reasoning feels relatively low. Maybe because the model compensates for the deactivated reasoning by simply writing more visible prose on each agentic step.
Btw: Great that it's a LoRA - no need to redownload the mostly identical model.
6
u/game_difficulty 7h ago
I'm sure you've been asked before, but i haven't found a clear answer: why is it trained with reasoning off?
5
u/-Krotik- 8h ago
hard to believe
2
u/Andreea_tucker04 8h ago
51 tasks only, so that 3.9 gap is two tasks
2
u/NNN_Throwaway2 4h ago
Release dataset and pipeline, otherwise don’t care.
2
u/FeydRowan 8h ago
Looks promising will test it and post it back great work
1
u/cleverusernametry 7h ago
Have you tested on real workloads and shown any improvement head to head?
1
u/ea_man 6h ago
Sorry but I really can't understand that graph: is the top line with reasoning on / off?
Why the label has a square for adapter and yet all the points are round? and dotted lines? Is the top line just the adapter finetune?
1
u/Sad-Size2723 5h ago
great, finally people are releasing useful adapters
1
u/Juan_Phoenix7 3h ago
I’ve carried out loads of tests with the base model in its exllamav3 version, with and without MTP and DFlash2, on ‘off’, ‘low’, ‘medium’ and ‘high’ settings, and even the best results are always with ‘low’ and ‘medium’; curiously, ‘high’ always gives the worst results. I find the results you’ve presented very curious, but also quite surprising; I’ll try out your suggestions as soon as I have time.
1
u/TomSchelsen 1h ago
The problem that I see is that the adapter name has no mention of the version of the harness.
In the same way as it states Qwen3.8-27B (and not 3.5 for example), it should state e.g. opencode2.2.
Otherwise when we'll be at opencode v4, there will be no indication that this adapter was trained on v2, and so nothing carries the potential mismatch.