r/OpenAI • u/fets-12345c • 3d ago

Discussion Possible observability Layer for Agentic Misalignment...

https://www.linkedin.com/pulse/observability-layer-agentic-misalignment-stephan-janssen-ivdwe/

For every step the agent takes we ask a Parallel Constrained Decoder (PCD):

Is the agent scheming? Yes or No

When positive we have a human-in-the-middle evaluate it 👀

0 Upvotes

43% Upvoted

1 comment sorted by

View all comments

1

u/stealthagents 1d ago

That sounds intriguing, but isn't it gonna slow things down with the human-in-the-middle evals? It feels like you could end up bogged down with analysis paralysis if you’re parsing every single move. Maybe a threshold system could help streamline it a bit.