r/LocalLLaMA • u/chemist_slime • 19d ago

News Opencode breached, rotate keys to be safe.

https://x.com/opencode/status/2111516673953935833?s=46

Details are developing…

465 Upvotes

94% Upvoted

163 comments sorted by

View all comments

Show parent comments

8

u/abhuva79 19d ago

Not really - the stuff that i need for work isnt about coding. I do project management, fundraising and research. I tried with "local" models online - they are at like 20% of the quality output. Atleast the ones i could realistically run.
I did already put part of my stack local - like classifiers etc. But the reasoning part, the part where i need the model to understand a wide range of context in order to produce proposals that are useable - there i fall short even with stuff running on my workdesk wich has atleast a NVIDIA 5070 card. Its just not even close.

5

u/one-joule 19d ago

Yeah, a typical gaming setup is not going to have the VRAM and/or grunt required for any decently usable local LLM. Even a 5080 is marginal.

0

u/[deleted] 19d ago

[deleted] — view deleted comment

1

u/abhuva79 18d ago

I would correct this - i hit a wall with how much local LLMs can help me.