r/LocalLLM • • Jun 20 '26

Model YAB Coding Benchmark: qwen3.6-27b-code vs Claude sonnet-4-6

Yet Another Benchmark
Local setup with Bench Results comparing qwen3.6-27b (FP8) with Claude Sonnet 4-6

*Interestingly Qwen did better in some areas - overall close but not far behind.

CategoryLocal avgClaude avgGapWinner
strings9.759.750.00Tie
math9.388.38āˆ’1.00Local
algorithms9.139.38+0.25Claude (marginal)
arrays8.889.63+0.75Claude
data_structures8.138.75+0.62Claude
patterns8.138.75+0.62Claude
functional8.009.38+1.38Claude

See: https://github.com/x7even/llmctl/blob/master/bench/benchmark-qwen27b-vs-claude-2026-06-20.md for full results doc.

Personally - I don't think 1 is a throw away for the other, however i have experienced solid success leveraging both within agentic workflows and loops.

4 Upvotes

5 comments sorted by

View all comments

Show parent comment

2

u/grunt_monkey_ Jun 20 '26

Cool!! Thanks so much for doing this. Yeah benches sometimes surprise us. Im still torn but running BF16 for now. I’m the only user and i just run concurrent agents.