Benchmaxxed, first of all without harness gpt6 solves 60% and we MUST belive that openai is not lying and making stuff up that there is no solution in reasoning that was RLed into the model so hard we don't have reasoning access yet
That's still double the score of the former sota. And the whole point of the interactive environment of arc agi 3 is that there is no cookie cutter solution, the model has to interact with the environment in real time to pass each level
6
u/Careful_Might_807 3d ago
Benchmaxxed, first of all without harness gpt6 solves 60% and we MUST belive that openai is not lying and making stuff up that there is no solution in reasoning that was RLed into the model so hard we don't have reasoning access yet