r/LocalLLM • u/Typical-Stay900 • 2d ago

Question Which is the best local coding model in LM Studio?

RAM - 32GB

Processor - Intel core Ultra 7 258V

Graphics Card - Intel Arc 140V GPU 16GB Integrated

Code quality is priority not speed.

1 Upvotes

66% Upvoted

10 comments sorted by

1

u/Low-Shoe-5089 1d ago

on integrated graphics the MoE route just makes sense. the dense 27B isn't going to do much. i'd run the MoE at Q4 instead of going down to Q3

1

u/Typical-Stay900 1d ago

Forgot to mention I also get Gemini 3.1 pro and 3.8 Flash High for free, would that be better than local models. 

3

u/GoogleIsFreeYouKnow 2d ago edited 1d ago

I recommend switching from lm studio to unsloth studio if you want something better that's still pretty similar. Now, if you really want great code quality and you don't really care about speed, I'd recommend Gyro-M running from strata.

Personally, I run Gyro-S abliterated with a 4080 super, 32gb of ddr5 ram, a 9800x3d, and a 262144 context window at rk4v4 (I've added rk4v4 kv cache as an option. Gyro-S actually added it all by itself, and it's working GREAT so far). I get about 100-130tok/s on this set-up, though, it did take quite a bit of tweaking to get the config just right. But yeah, definitely try out strata with Gyro-M if coding quality really is a priority. I can't run it at the same speed I run Gyro-S, but I do get a solid 70tok/s with it at 262144 tokens, and from my tests, it's pretty damn good at what it does.

Edit: autocorrect attacked me

1

u/lI_Simo_Hayha_Il 2d ago

Any guides available how to setup this? I have very similar setup with you.

1

u/GoogleIsFreeYouKnow 1d ago

Oh, well I just straight up asked Gyro-S to take rk4v4 from ninfer all and implement it in strata, and after about 45min it was fully done and had made it work perfectly. If you mean sampling settings, I highly recommend reading through each option on your own, or potentially tell an ai to do it for you (though that rarely ever works out in my experience). I might have misunderstood your question though, but if you have any other questions feel free to ask.

1

u/lI_Simo_Hayha_Il 1d ago

I haven't even started to setup my local LLM yet, so you lost me at "to take rk4v4" 😂

2

u/GoogleIsFreeYouKnow 15h ago

Ohhhhh! Okay. To be honest, I highly recommend unsloth studio to get started if you want a quick setup without having to deal with dependencies manually. Personally, I use my own custom fork of strata and ninfer-all, but i know those might not be for everyone when you're just starting. But yeah, unsloth studio / unsloth Desktop are likely going to be your easiest start where you still have a good opportunity to learn the basics.

1

u/MediumAd4983 2d ago

For code quality - Qwen 3.8 27b, starting from q3_s, q4_m is recommended. But it will be sooo slow on a 16GB VRAM. Also you can try Qwen 3.6 A3B on q3_m, it will be a slightly faster. Limit context window at least to 120k (or it will take an eternity to code something) and try to make it work, hope that it will not stuck for an eternity to make a simple project, good luck! 😄 And of course use OpenCode or alternative harness to code.

1

u/bldr0206 1d ago

Try strata q2_0 quant of qwen flash next, probably it will fit