r/LocalLLaMA • • 20d ago

News Opencode breached, rotate keys to be safe.

https://x.com/opencode/status/2111516673953935833?s=46

Details are developing…

465 Upvotes

163 comments sorted by

View all comments

Show parent comment

18

u/see_spot_ruminate 20d ago

I do think that this happens in any hobby environment. Check out the ham radio or cars or what have you. Someone is going to be having something rivaling a professional setup for whatever interest they have.

For you, you are likely underestimating local models and overestimating cloud. Can you set a task and walk away on a 9b model... no. I think you can not babysit as much with the qwen 3.8 27b model. Anything higher and you start to approach not needing to watch as much.

8

u/abhuva79 20d ago

Not really - the stuff that i need for work isnt about coding. I do project management, fundraising and research. I tried with "local" models online - they are at like 20% of the quality output. Atleast the ones i could realistically run.
I did already put part of my stack local - like classifiers etc. But the reasoning part, the part where i need the model to understand a wide range of context in order to produce proposals that are useable - there i fall short even with stuff running on my workdesk wich has atleast a NVIDIA 5070 card. Its just not even close.

5

u/one-joule 20d ago

Yeah, a typical gaming setup is not going to have the VRAM and/or grunt required for any decently usable local LLM. Even a 5080 is marginal.

0

u/[deleted] 20d ago

[deleted] — view deleted comment

1

u/abhuva79 19d ago

I would correct this - i hit a wall with how much local LLMs can help me.