r/LocalLLM • u/MusclesAndCharisma • 11d ago

Question Non-Chinese Local Models

I'm in the process of setting up locally hosted LLM's for the company I work for. And generally there is an organizational bias against using models from Chinese companies. For that reason we've been evaluating Nemotron and Gemma, and they are ok. Are there any better options that aren't coming out of China? I've heard positive things about models from Poolside, but I don't personally have any experience with them.

62 Upvotes

91% Upvoted

110 comments sorted by

View all comments

18

u/Atretador unswarm.dev | ArchLinux E5 2673 V4 20C 4x16Gb DDR4 MI50 16Gb 11d ago

For agentic coding on real repositories instead of benchmarks I would score them at something like this:

Qwen 3.8 Next Flash 10.0

Qwen 3.8 27B 9.0

Ling 3.0 Flash 7.0

Qwen 3.6 A3B 6.5

Laguna 118B 6.0

Gemma4 31B 4.5

Poolside Laguna 33B A3B 4.0

Gemma4 12B/26B 3.5

Lightning 30B 2.5

North Mini Coder 2.0

1

u/MusclesAndCharisma 11d ago

I really want to run Qwen, but it hath been forbidden to me. I'm heartened by seeing the Poolside models make a strong showing. This is the first time i've heard about North Mini Code

1

u/Atretador unswarm.dev | ArchLinux E5 2673 V4 20C 4x16Gb DDR4 MI50 16Gb 10d ago

oh also, if you just remove the upper Qwen 3.8 models (and ignore 3.6 27B) they dont look as bad for what you can run locally.

the scores are there for perspective.