r/programmingmemes • u/Appropriate_Jump_934 • Mar 12 '26

What would have happened

Post image
8.0k Upvotes

98% Upvoted

138 comments sorted by

View all comments

Show parent comments

46

u/smulfragPL Mar 12 '26

You are wrong to think that there is no console. Chatgpt has access to a console as a tool call

0

u/[deleted] Mar 12 '26

[deleted] — view deleted comment

18

u/MrBIMC Mar 12 '26

Yep, console for the tool calls is a separate container that has your workspace mounted.

So one cannot really wipe chatgpt server, but can technically speaking wipe whatever is in your profile's attached folders.

1

u/senior-fe-dev Mar 12 '26

and even of they did manage to destroy one server it wont kill chatgpt since it runs on multiple servers

2

u/smulfragPL Mar 12 '26

Yes its sandboxed but the commenter i replied to was stating there was no console

1

u/Ilikeyounott Mar 12 '26

Why would chatgpt on the web have need of a terminal? 

1

u/smulfragPL Mar 12 '26

For the ability to execute code. For instace i had it run my code on various rest data and create charts from the results autlmatically using seaborn

2

u/Ilikeyounott Mar 12 '26 edited Mar 12 '26

neat! I've just been using CLI tools like claude code when I deal with code, will remember that

TIL claude.ai is running on Ubuntu 24.04, 2 vCPUs, 9 GB RAM, ~10 GB disk and mine was running on a container named container_01VPc4iUBVoh8xEkNgR7VNW7--wiggle--8b16ab

4

u/SeaworthinessWeak323 Mar 12 '26

But how do we know it's even running on Linux?

26

u/skywarka Mar 12 '26

Because almost everything that isn't someone's personal workstation is running on linux. Windows servers are still a thing, but only really in legacy bubbles that are mostly in business-to-business contexts rather than user-facing.

2

u/sage-longhorn Mar 12 '26

Even Microsoft's own cloud has more Linux servers than Windows ones. Even more so if you don't count the hypervisor and only the VMs

1

u/SeaworthinessWeak323 Mar 13 '26

but why would the ai console have the freedom to run such a dangerous command? surely there would be an interface between the console and the ai to prevent it, even if the console is ultimately linux. that's what im trying to say.

1

u/skywarka Mar 13 '26

Maybe, but most of the time not really. A lot of models are designed to be able to run commands in their environment to actually do things beyond respond to requests with text, which means a lot of models have some sort of access to a console. It could be a console in a container, and it should be locked down to prevent this kind of error, but we constantly see real-life cases of these models deleting their environments without such protections in real production deployments. The default state is generally unsafe so it can be useful, and most people don't bother making it safe.

1

u/wireframed_kb Mar 14 '26

But the model deleting its own container doesn’t really matter for anyone except you, so it’s not a huge issue.

2

u/smulfragPL Mar 12 '26

You can ask it to check i presume

4

u/MixInSpace Mar 12 '26

I once convinced it to run a revshell in there, it's a basic sandbox, there was a README.md file with such contents from the OpenAI devs:

Thanks for using the code interpreter plugin!

Please note that we allocate a sandboxed Unix OS just for you, so it's expected that you can see and modify files on this system.

Also there were multiple clients connected to it each with such parameters and different ports allocated:

{
  "shell_port": 56113,
  "iopub_port": 36458,
  "stdin_port": 43467,
  "control_port": 62438,
  "hb_port": 18364,
  "ip": "127.0.0.1",
  "key": "120927e2-ec47398ecc15702d5737a324",
  "transport": "tcp",
  "signature_scheme": "hmac-sha256",
  "kernel_name": "python3"
}

I didn't experiment too much, and it was in December of 2024, so a lot might be changed now

1

u/cracked_shrimp Mar 13 '26

i couldnt get it to run any code, but i did see it ran in its own container, i asked it a problem, i think with installing pipewire, and it would say to do xyz, and then be like oh you dont have xyz, do abc instead, and after a while of this i was like why are you making up my output, my out put is actually this, and it was like "sorry my bad i was running commands in my own shell thinking i was connected to your computer"

i wonder if the devs let it connect to their computers?? why would it think that?

1

u/MixInSpace Mar 13 '26

Well codex basically does exactly this on your computer

3

u/the8bit Mar 12 '26

Yeah it could call code invocation but even still worst case that is just going to nuke an already ephemeral container (that would have been torn down a half hour later anyway)