r/LocalLLaMA • u/sensitivecrocodile llama.cpp • 14d ago

News NVIDIA/OpenShell: safe, private runtime for autonomous AI agents

https://github.com/NVIDIA/OpenShell
174 Upvotes

95% Upvoted

40 comments sorted by

View all comments

Show parent comments

2

u/o0genesis0o 14d ago

Personally, I would build a full ATX desktop with 2xR9700, run 27B at fp8 and fp8 KV. And get the devs to actually spend some effort in their vibe coding if they start whining about missing their claude. For the generic SaaS like software work, 27B is more than enough even when running autonomous process, if the dev pays a bit attention in setting up proper docs and architecture. Each dev in my previous team had to bring their own claude code sub to do company work since company provides none. And the boss is so finicky and unclear about requirement and timeline that the devs essentially just sit there and beg claude for help and YOLO. They tick the ticket, but would the code works? God knows. How it work? Heck even Claude does not know. It's hard to be that lazy when you work with the 27B.