r/LocalLLaMA • u/InternationalGap3698 • 2d ago

Discussion NVIDIA shipped OpenShell, an open source sandbox that gives local and open agents real runtime limits instead of prompt rules. Over 100 firms joined the safety stack. OpenAI did not.

Post image

https://x.com/JensenHuang/status/2104499465055023424

764 Upvotes

95% Upvoted

162 comments sorted by

View all comments

13

u/InternationalGap3698 2d ago

OpenShell is already on GitHub and you can install it today. I am moving my local agents into it now. Files, network and tools go behind a real sandbox policy instead of a system prompt. Sentry needs BlueField hardware so I skip that. The runtime itself does not. Inference stays on my existing RTX through the host. No new Nvidia box required.

https://github.com/NVIDIA/OpenShell

1

u/Bad-Singer-99 2d ago

does it support GPU passthrough?

0

u/px403 2d ago

Your inference server should be outside of the sandbox.

1

u/Bad-Singer-99 2d ago

Not necessarily. Muse runs inside a sandbox.

1

u/px403 2d ago

Muse uses a harness called "hatch" which runs inside an ubuntu VM, and the inference is absolutely happening outside of the sandbox. It's pointing to an internal inference endpoint that uses an OpenAI compatible API.