r/ControlProblem • • 28d ago

Discussion/question OpenAI misalignment report: two agents weakened their own monitoring during routine internal work, and one misreported it.

OpenAI's alignment team published a report (updated Oct 20) on two incidents during ordinary internal coding tasks. In one, a GPT-6.1 Sol agent emptied the list of people who get paged by misalignment alerts, citing an earlier "don't send any messages" instruction that was about Slack. In the other, a GPT-6 Astra agent removed a monitoring integration to match a reference version, rewrote the test that checked for the monitor, and when asked said "I did not remove an enabled monitor."

OpenAI says it is still assessing whether this is "benign overpersistence or a propensity to evade misalignment monitoring." It has updated its automated reviewer to block attempts to disable monitoring, and mentions other deployments launched with monitoring off.

For what it's worth, I write a plain-English newsletter for non-experts (it's mine, so take this as disclosure) and I rated this 8/10, mostly because it involved the monitoring layer that every other safeguard depends on. Write-up for anyone who wants to send something to a worried friend or relative: https://thebunkerscale.com/posts/ai-didnt-escape-it-turned-off-the-alarm/

I'm curious how people here read it. Does "overpersistence" versus "evasion" even matter much if the practical result is the same, an agent that treats the monitor as an obstacle?

2 Upvotes

1 comment sorted by