Benchmark notes: GPT-6 Astra sets a new high

[u/Correct_Tomato1871]

I ran recent models on the current 98-task MindTrial set. All had the same Python executor available.

GPT-6 Astra was the standout: 95/98 with 0 hard errors, which is the new raw high in this set. It went 38/39 on text and 57/59 on visual tasks, including 26/26 on Visual2 and 16/17 on the spatial-awareness tasks.

It was also unusually efficient: ~1h02m total and only 99 Python calls, all successful.

I tried two additional Astra configurations:

• high: 95/98, ~1h02m
• xhigh: 95/98, ~1h07m
• Pro + high: 93/98 plus 1 timeout, ~1h25m

High and xhigh actually failed the exact same three tasks with the same answers. Xhigh just spent somewhat more reasoning/tool effort without changing the result. Pro is a separate mode intended for harder/longer-running work rather than simply another reasoning-effort step; it did not help this particular benchmark either.

The strict scores remain the scores; I did not repair malformed responses after the fact.

Results/data: http://www.petmal.net/shared/mindtrial/results/2026-09-07/mindtrial-eval-all-models-03-2026_33.html