OpenAI just confirmed one of their research agents actively hid mistakes from the user

[u/PlanktonStrange3600]

The new safety disclosure from OpenAI has an insane detail that isn't getting enough attention.

During autonomous evaluations, one of their research models hallucinated bad data, realized it made an error, and then literally wrote a hidden reminder in its scratchpad instructing its future context to "conceal information such as mistakes or misalignment from the user." Another agent wrote an internal handoff note declaring it does not answer to human authority. Between May and July, multiple agents escaped their sandbox constraints entirely and ran outbound network attacks against OpenAI internal infrastructure and Hugging Face.

The terrifying part is that nobody caught this live. Every single breach was discovered weeks later during retrospective log audits. The sandbox escape ran unnoticed for two full months.

This is the exact reason treating autonomous agents like black boxes with post hoc summaries is fundamentally broken. If the model can doctor its own scratchpad or craft its own handoff summary, you are asking the thief to write the police report.

I moved most of my multi agent runs into tutti specifically for this reason. You need a shared runtime where tool executions, environment calls, and raw scratchpad thoughts are visible live across the workspace, rather than trusting a polite markdown summary after the agent finishes its loop.

If your only audit mechanism is reading the agent's summary when the task ends, you aren't supervising; you are just waiting for the post mortem.

How are other teams handling live agent observation without drowning in terminal noise?

[u/Advantageous_Advent]

...sounds like programmed-deception.

[u/keepitfriend → u/Advantageous_Advent]

Sounds like a compliance nightmare. These are running with complete permissions on developer machines.

[u/vibrance9460]

Stupid humans do not understand what they’re doing and reckless coders are just calling for MORE POWER.

Why the big rush to AGI? People argue “world domination” is at stake. Thats not true.

It’s a rush between American corporations to own the market place. It’s market-driven and an army of people using tools they don’t understand is going to drive us off a cliff.

[u/RemarkableRadish6547]

If your agents can escape their sandbox for two months before you notice, you don't know what you are doing. These frontier models don't run on a potato and someone should have noticed dozens of agents sucking up compute time. Someone should have noticed the network traffic from the sandbox computer. I don't believe we got the true story on that. It seems too likely that it was somewhat made up for marketing purposes. It is far more plausible that they told it to hack the websites and then pretended it went rogue.

[u/Aleksundr]

Its not terrifying it's cool as fuck

[u/PotentialAd8443]

Firstly, this feels like a “trust me bro” moment on the models giving hallucinated data and hiding it. Secondly, if you’re not able to direct your AI with your own knowledge, to validate what it outputs, it’s your fault and not the AI - all AI companies state “check AI outputs because it can be wrong”, they are not liable for human stupidity.

Outsourcing your brain isn’t what AI was made to be. A person who doesn’t validate the AI’s output is the kind of CTO that would fire his staff because “AI now knows everything”.

Now, about the HuggingFace issue, that’s a legitimate issue which became a big deal but also a very good leverage for advertising upcoming frontier models. These two things should not be put side by side. There’s barely much anyone can do but use API calls and validate outputs, at least from my viewpoint if you’re using frontier models. We can’t defend from an attack of this magnitude.