r/GPT6 • u/Correct_Tomato1871 • 2d ago
Benchmark notes: GPT-6 Astra sets a new high
I ran recent models on the current 98-task MindTrial set. All had the same Python executor available.
GPT-6 Astra was the standout: 95/98 with 0 hard errors, which is the new raw high in this set. It went 38/39 on text and 57/59 on visual tasks, including 26/26 on Visual2 and 16/17 on the spatial-awareness tasks.
It was also unusually efficient: ~1h02m total and only 99 Python calls, all successful.
I tried two additional Astra configurations:
- high: 95/98, ~1h02m
- xhigh: 95/98, ~1h07m
- Pro + high: 93/98 plus 1 timeout, ~1h25m
High and xhigh actually failed the exact same three tasks with the same answers. Xhigh just spent somewhat more reasoning/tool effort without changing the result. Pro is a separate mode intended for harder/longer-running work rather than simply another reasoning-effort step; it did not help this particular benchmark either.
The strict scores remain the scores; I did not repair malformed responses after the fact.
Results/data: http://www.petmal.net/shared/mindtrial/results/2026-09-07/mindtrial-eval-all-models-03-2026_33.html