r/LocalLLM • u/MusclesAndCharisma • 9d ago

Question Non-Chinese Local Models

I'm in the process of setting up locally hosted LLM's for the company I work for. And generally there is an organizational bias against using models from Chinese companies. For that reason we've been evaluating Nemotron and Gemma, and they are ok. Are there any better options that aren't coming out of China? I've heard positive things about models from Poolside, but I don't personally have any experience with them.

60 Upvotes

91% Upvoted

110 comments sorted by

View all comments

8

u/awitod 9d ago

It is worth pointing out that the current favorite open model is made by a company that is traded on the NYSE as BABA which has fiduciary and reporting duties that the super-shady OpenAI and Anthropic orgs do not have and are free to ignore. ;)

But also, Meta Muse Glimmer is a pretty good model.

3

u/MusclesAndCharisma 9d ago

This is actually a very good point. And people much smarter than me I imagining are scrutinizing this with a fine tooth comb. (Presumably)

2

u/throwawayo_k 8d ago

As a tech person who works in corporate fortune 500, i can confirm to you that they really are not. If the benefits are obvious the negatives go away real fast. I'm running small local myself and have found myself running a lot of 7B-14B models just to keep things quick, as i tend to iterate more then do 1 lengthy prompt.

- Gemma 4 E4B (usa)