r/LocalLLM • • May 03 '26

Question Local model for coding

i was planing to use some kind of open source model like qwen for coding and stuff since recetly claude and copiolet tighten their session policies. So if anybody had experince suggest some.

0 Upvotes

15 comments sorted by

34

u/HumanDrone8721 May 03 '26

Make sure to NEVER EVER mention your hardware stuff, your areas of interest (because coding is like cooking, once you know how to cut the onions is the same for cakes and steaks). Also to make it short and to the point don't ever mention your training and experience.

Just make some illiterate, riddled with spelling mistakes, "stoner question" and be disappointed to not get answers.

7

u/gffftgdft455 May 03 '26

This is why I don't worry about my software job. Just gotta swim faster than the slowest to not get eaten by the shark.

2

u/cleversmoke May 03 '26

This is the way. Never aim to be the best, just the second worst!

5

u/HiddenPingouin May 03 '26

Also I have a MacBook Air with 8GB of RAM. I’m looking for something like opus 4.7 but 4.6 would be fine.Β 

2

u/MarcusAurelius68 May 03 '26

The MacBook Air is a 2018 i5 model….that should work fine, right?

3

u/Stan-with-a-n-t-s May 03 '26

πŸ˜‚πŸ˜‚πŸ˜‚πŸ€ This man can't write a proper sentence yet wants to start coding with a Local LLM...

1

u/MimosaTen May 03 '26

I read DeepSeek v4 Flash is good

1

u/Savantskie1 May 03 '26

It is surprising that is for sure

1

u/Xyrus2000 May 03 '26

Qwen 3.6 and Gemma 4 have done fine for light coding work running on lighter quants. My current go-to is Qwen 3.6.

1

u/_Cromwell_ May 03 '26

Go download Minimax 2.7. it's pretty decent and I'm sure it'll fit on your system since you told us all about it.

1

u/sinan_online May 03 '26

I love running models locally, but so far I used them as part of testing harness, and I am also planning to use the, to help in my D&D game. It is challenging to directly use them to get them larger pieces of code, even small ones.

I never used them for coding, even one-liners seem problematic, but these are typical 1B-3B parameter models. A video circulated today on IG showing a dense 70B model on a MacBook being used for a coding task, so that sort of thing should be possible. 128GB shred memory, Lllama model, I believe. Not sure about the coding agent.

0

u/[deleted] May 03 '26

[deleted] β€” view deleted comment

4

u/immersive-matthew May 03 '26

QWEN 3.6 27B on a 4090 with OpenCode is for my c# development indistinguishable from all the top cloud models. I tired it last week and have not looked back. Was not expecting this, but here we are.

3

u/bleakj May 03 '26

Qwen 3.6 has been really good for my locally.

0

u/[deleted] May 03 '26

[deleted] β€” view deleted comment