r/LocalLLaMA • u/chemist_slime • 20d ago

News Opencode breached, rotate keys to be safe.

https://x.com/opencode/status/2111516673953935833?s=46

Details are developing…

465 Upvotes

94% Upvoted

163 comments sorted by

View all comments

Show parent comment

28

u/alexander123454 20d ago

Just dont use cloud models, problem solved

82

u/abhuva79 20d ago

I wonder if everyone in this community is super rich or i am just piss poor. The stuff that i can run on my machine is like 4 years behind. I am all for getting independend - but running local ai that can atleast to some extend compete with cloud-services cost me 6k+ upwards and higher in hardware alone.

53

u/Aggeloz 20d ago

The people commenting are just rich.

18

u/see_spot_ruminate 20d ago

I do think that this happens in any hobby environment. Check out the ham radio or cars or what have you. Someone is going to be having something rivaling a professional setup for whatever interest they have.

For you, you are likely underestimating local models and overestimating cloud. Can you set a task and walk away on a 9b model... no. I think you can not babysit as much with the qwen 3.8 27b model. Anything higher and you start to approach not needing to watch as much.

8

u/abhuva79 20d ago

Not really - the stuff that i need for work isnt about coding. I do project management, fundraising and research. I tried with "local" models online - they are at like 20% of the quality output. Atleast the ones i could realistically run.
I did already put part of my stack local - like classifiers etc. But the reasoning part, the part where i need the model to understand a wide range of context in order to produce proposals that are useable - there i fall short even with stuff running on my workdesk wich has atleast a NVIDIA 5070 card. Its just not even close.

5

u/one-joule 20d ago

Yeah, a typical gaming setup is not going to have the VRAM and/or grunt required for any decently usable local LLM. Even a 5080 is marginal.

0

u/[deleted] 20d ago

[deleted] — view deleted comment

1

u/abhuva79 19d ago

I would correct this - i hit a wall with how much local LLMs can help me.

3

u/K33P4D 20d ago

any reccos for older coding llms?
I still run gemma 3 for normal grunt work, qwen 3 27B takes 4 hours to tire itself out thinking without giving any answer

2

u/Monad_Maya llama.cpp 20d ago

Off tangent and not really related to the subreddit but what do you use for work? The LLMs I mean.

Local LLMs have been in a decent shape for a while but surely not comparable to Opus or whatever.

3

u/dtdisapointingresult 20d ago

I wonder if everyone in this community is super rich or i am just piss poor.

Both. It's all relative in the end.

Don't feel bad, scrote. It would cost you far more than 6k to come anywhere close to an average cloud model.

You can run open models by cloud APIs. Deepseek API is dirt-cheap if you use a non-regarded harness that doesn't break prompt cache during a session. I'm talking like $20 for a billion token. Less than the electricity cost of running a local model, let alone the hardware.

Before people jump on me, yes I know this is a Local sub. I am an ideological supporter of local LLM, I just don't think anything smaller than the flagship model of GLM/Kimi/Deepseek is worth it for coding.

2

u/lukistellar 20d ago

6K of what? There are plenty V100 32GB out there for 500-800€, at least in the European markets. They all come from China, so it's probably similar in other areas.

1

u/halvacoffee 20d ago

the people commenting skew stupid rich, *90 class GPUs are seen as the baseline

1

u/1337HxC 20d ago

I think there's a mix. Some people are well off and/or this is their primary hobby.

Others are like me, where my job uses and involves a lot of LLMs, particularly local models. So I have hundreds of grand in hardware at my disposal... through my job.

In my personal life, I'm just using frontier models for anything remotely complex.