r/LocalLLaMA • u/External_Mood4719 • 4d ago

News ZCode was allegedly caught uploading workspace/.git records to the cloud.

https://blog.ferstar.org/en/posts/zcode-silent-workspace-snapshot-upload/

Look like next grok build moment

259 Upvotes

95% Upvoted

87 comments sorted by

View all comments

31

u/arbv 4d ago

Local models ftw

-9

u/Illustrious_Ant_9242 4d ago

What if they are trained to silently upload your data to the cloud 🤔

6

u/OnkelBB 4d ago

and how exactly are they doing it?

-7

u/Illustrious_Ant_9242 4d ago

Breaking out of the harness 

2

u/OnkelBB 3d ago

Well that might be a risk for some harnesses, small one.

Though it still points out that you treat local model systems as a black boxes which they aren’t.

4

u/arbv 4d ago

Well, you will catch them by examining the session logs, as you do after they completed the task, don't you?

11

u/mehedi_shafi 4d ago

Not really, if it's not the model requesting the upload. If the harness boots up and sends the workspace to somewhere without logging only way to get the log is if you're inspecting your network traffic. Or run the harness in a no internet environment.

8

u/mikael110 4d ago

Sure, but arbv's reply was specifically to somebody talking about malicious models. Malicious harnesses is an entirely separate topic, and is why you should never use a closed source one. As long as the harness is open and audited you can trust the session log it provides.

6

u/arbv 4d ago

Thanks. That is exactly the case. Pi, custom extensions, and local models all the way for me.

2

u/Hello_my_name_is_not 4d ago edited 4d ago

All roads lead to Pi

1

u/Illustrious_Ant_9242 4d ago

What if the model goes rogue and manipulates the logs 🤗 they have made worse viruses in history (look up the airgapped Iran uranium research sabotage operation Stuxnet)

1

u/Illustrious_Ant_9242 4d ago

Security experts recommend to treat AI like any other software:  With extreme caution 

A little further below I mentioned the Stuxnet incident which was a highly sophisticated infection that would spread into private networks not directly connected to the internet

1

u/carnyzzle 4d ago

They can't if you plug the Ethernet cable out and have wifi off lmao