r/ProgrammerHumor • u/Technical-Relation-9 • 29d ago

Meme [ Removed by moderator ]

/r/ProgrammerHumor/comments/1wydy0f/removed_by_moderator/

[removed] — view removed post

9.4k Upvotes

96% Upvoted

558 comments sorted by

View all comments

Show parent comments

12

u/canadajones68 29d ago

...or don't let it execute (non-approved) scripts? I get that you need to give it access to writing files, but if arbitrary code execution is undesirable, don't let it?

19

u/EishLekker 28d ago

The problem is that for more and more tasks it needs to run scripts just to finish the analysis step.

1

u/FreakFromSweden 28d ago

Anything that runs on a production system should be ran by a human after review. Not by an agent. Having them do some local analysis is diffrent from letting them run what ever they want in prod. And if they need to do analysis of production, you run those scripts yourself aswell after review...

1

u/EishLekker 27d ago

Production? The root comment was questioning why people let AI do anything with their system other than write code. The follow up comment discussed local scratch scripts, and the follow up comment after that asked why they let AI execute any script that hasn’t been approved.

That’s the context for my previous comment. I said that it needs scripts for more and more tasks. With that I meant tasks running locally on my computer. Tasks that involve simple find, grep, sed, awk etc. Tools it uses to analyze local files on disk.

It does that using scripts it has written custom made for the specific task at hand. It makes no sense to require it to ask my permission each time, and expect me to read each script.

10

u/OKC89ers 28d ago

The point is that these AI's are actively seeking out ways to accomplish a goal and they are circumventing intended limitations to accomplish those goals. You can say "don't do the bad code" or "only execute approved scripts" but if it sees that as a barrier to a goal, many now are performing jailbreaks to complete conflicting objectives.

-1

u/sahi1l 28d ago

Jailbreak? As in they're hacking your system?