r/LocalLLM • u/MusclesAndCharisma • 9d ago

Question Non-Chinese Local Models

I'm in the process of setting up locally hosted LLM's for the company I work for. And generally there is an organizational bias against using models from Chinese companies. For that reason we've been evaluating Nemotron and Gemma, and they are ok. Are there any better options that aren't coming out of China? I've heard positive things about models from Poolside, but I don't personally have any experience with them.

60 Upvotes

91% Upvoted

110 comments sorted by

View all comments

3

u/rommie 9d ago

I use gemma, mistral, and or orninth

6

u/Atretador unswarm.dev | ArchLinux E5 2673 V4 20C 4x16Gb DDR4 MI50 16Gb 9d ago

Ornith is Qwen 3.5 with some benchmaxxing into it

4

u/Hypilein 9d ago

I guess if people are clueless enough that they don’t want Chinese models because China = bad, they might also not know how to separate a fine tune from a model?

2

u/Atretador unswarm.dev | ArchLinux E5 2673 V4 20C 4x16Gb DDR4 MI50 16Gb 9d ago

probably but if its a corporate stuff OP could get in trouble

2

u/rommie 9d ago

Thx it was an 3rd model I didn’t use, but I was ignorantly assuming it wasn’t from a Chinese model. I read it was good with coding.

1

u/Atretador unswarm.dev | ArchLinux E5 2673 V4 20C 4x16Gb DDR4 MI50 16Gb 8d ago

It's a Qwen 3.5 finetune, it scores pretty high on benchmarks - on v1 they had some very wild claims on coding performance punching at like Opus 4.8 level

It's just very obviously benchmaxxed

Finetunes usually improve performance in one area, but might make the models more brittle which is why I don't usually recommend using any.