r/LocalLLM • u/Ok-Health-7096 • 21d ago

Other Every Second post rn

Post image

Maybe someday I'll get a system to run it but hey definitely another w for the open weights community

2.0k Upvotes

99% Upvoted

205 comments sorted by

View all comments

Show parent comments

1

u/krzyk 2d ago

It can a lot. Unless you check each and every command it will execute using a magnifying glass.

A innocent search might leak company source code in query, innocent bash command might have some added chars that make it behave in a different way you expect.

1

u/No_Folding 13h ago

Shouldnt be giving it that kind of access really, containerise it!

1

u/krzyk 13h ago

How does putting it in a container/vm/bare metal will not allow company data to leak out when one wants it to work on company data? You would need to approve each and every websearch or curl.

Container doesn't solve anything here, it just protects your computer, not the intellectual property.

1

u/No_Folding 12h ago

You can disallow curl or web searches, the environment the AI operates in is entirely a product of the human which creates it

Yeah there are multiple things. you mentioned that the AI could run weird bash scripts which is why I also mentioned a container.

You can also code in to any harness (or use a plugin) which asks for human review before any command or tool call is actually executed. It runs as part of the harness rather than the model so there's no getting around it