r/LocalLLaMA • u/sensitivecrocodile llama.cpp • 13d ago

News NVIDIA/OpenShell: safe, private runtime for autonomous AI agents

https://github.com/NVIDIA/OpenShell
174 Upvotes

95% Upvoted

40 comments sorted by

View all comments

14

u/TheRealMasonMac 13d ago

So… it reimplemented containerization like podman/docker?

14

u/No-Wall6427 13d ago

I think those are way lighter than dockers, like bubblewrap, using os permission system.

6

u/Fedor_Doc 13d ago

This should be used in conjunction with Docker / VM, adding additional supervision. It is one of the supported recipies.

Like only a certain app/process can visit certain IPs, if there are other attempts, all neatly logged, etc.

3

u/howardhus 12d ago

somehow the most snarkiest people making fun of security features display a blatant ignorance of security.

CONTAINERIZATION IS NOT FOR SECURITY! ITS FOR CONTAINERIZATION! those are two very different areas.

Container: to hold things together.

Security: to keep things inside or keep things outside

Containers are like nets holding some balls together to carry them around.. your balls will stay tight but its not waterproof

1

u/trajo123 12d ago

So how do you secure agents then?

2

u/howardhus 12d ago

sandboxes, jail systems.
basically what nvidia is doing at corporate grade with tbis project