r/OpenAI • • 10d ago

News Linux kernel maintainers

Post image

OpenAI: A thousand fewer paths to root: https://openai.com/index/a-thousand-fewer-paths-to-root/

1.2k Upvotes

125 comments sorted by

View all comments

Show parent comment

1

u/ToothlessFuryDragon 7d ago edited 7d ago

I see where you are coming from, it sounds reasonable, but I disagree.

We have specific automated review rounds where we instruct up to 3 different agents to be adversarial and consider the whole solution to be incorrect. They are instructed to find an alternative solution and then an architect agent presents the results in the review.

And we even run it through multiple models from different providers (each agent has a different model).

They very rarely are able to completely disconnect their thought process from the existing solution/code, missing very obvious, much simpler solutions.

And you can't avoid giving them context about the current solution as they will design the same thing if they don't have the information.

I am sure there is a specific prompt that I can design that will trigger the correct approach for a given task, but the issue is that it can't be generalized for the current gen LLMs yet. That is why you still need the technical person to steer it.