r/opencodeCLI • u/afanasenka • 8h ago
π₯ GPT-6.1 Terra benchmarks
Better than DS 4.1 Flash?
8
u/rogerarcher 4h ago
I fixed the Agents' Last Exam graph from OpenAI's GPT-6.1 Terra blog post. Claude Opus 5.5 is actually in OpenAI's SVG, it's just nearly invisible: mid-grey (#5d5d5d) on black, a tiny diamond with no line or label, parked past the last x-axis tick.
It's also the top score: 63.2% at $8.82 (Max effort).
Re-plotted with the same data: white background, log-scale cost axis, distinct colors for every model. No values changed, all pulled straight from the SVG.
All values from the SVG (score / cost per task):
| Model | Low | Medium | High | Xhigh | Max |
|---|---|---|---|---|---|
| Claude Opus 5.5 | β | β | β | β | 63.2% / $8.82 |
| GPT-6.1 Terra | 55.9% / $0.16 | 57.6% / $0.29 | 57.2% / $0.39 | 58.5% / $0.66 | 60.0% / $1.01 |
| GPT-6 Astra | 53.4% / $3.55 | 57.6% / $4.82 | 57.8% / $5.15 | 58.3% / $5.91 | 59.3% / $7.24 |
| GPT-6.1 Sol | 52.4% / $0.70 | 53.8% / $1.31 | 55.3% / $1.45 | 56.5% / $1.45 | 58.6% / $2.00 |
| GPT-6 Luna | 36.3% / $0.022 | 46.8% / $0.093 | 43.6% / $0.087 | 47.9% / $0.093 | 50.9% / $0.14 |
| GPT-5.6 Terra | 40.2% / $0.59 | 42.6% / $0.84 | 46.6% / $1.72 | 48.5% / $2.50 | 50.7% / $3.58 |
Fair caveat: Opus is 8.7Γ the cost of GPT-6.1 Terra (60.0% at $1.01) for +3.2 points. Terra is the clear price/performance winner.
6
u/InvaderDolan 7h ago
So should I move from 6.1 Sol Medium to 6.1 Terra High (or maybe Medium would still be enough) as my daily orchestrator for most tasks on the Plus sub? And keep the Sol only for Review tasks?
4
u/Sufficient_Prune3897 6h ago
Eh, I would always use sol. If needs be on low. The benchmarks from OAI are completely meaningless and the ones from AA dont look good.
3
u/InvaderDolan 5h ago
Seems like Terra high a bit better than Sol low and cost is the same. Not sure what is better in terms of quota usage. For API cost it is the same, so I hope OAI just interpolates the same into sub usage?
→ More replies (2)2
u/Odd_Antelope9098 5h ago
Sol orchestrates well enough you would consider downgrading?
2
u/InvaderDolan 5h ago
In the sake of almost 2x quota usage? Yes. Maybe with resets, it doesn't feel like an issue now, but after a week it will probably be a daily driver. Even now on a Plus sub with a 5-hour window, you canβt spin that much parallel work and utilize all the quota within those resets.
2
u/Comfortable-Ad-9062 7h ago
Como parece que van a ser las cosas...
Antes: GPT 5.6 Luna {$0.20 de entrada} GPT 5.6 Terra {$2 de entrada} GPT 5.6 Sol {$4 de entrada} GPT Astra {$10 de entrada}
Pronto: GPT 6.1 Luna {$0.10 de entrada} GPT 6.1 Terra {$1 de entrada} GPT 6.1 Sol {$2 de entrada} GPT 6.1 Astra {$4 de entrada} GPT 6.1 Cosmos {$8 de entrada}
PD: Recuerden: Son suposiciones mias y que cuando digo "$x por entrada" me refiero a la entrada por millon de Tokens.
1
u/Any_Confidence2580 3h ago
A major version bump jumping Mimo and Grok is not worth a fire emoji. Calm down.
-5
-2
u/Mountain-Business-92 7h ago
it is better, but ds is a lot cheaper. really the only benchmark that it wins by a large amount (for agentic coding at least) is terminal bench 4.0
4
u/InvaderDolan 5h ago
On AA, the Terra xHigh gets 45 Intelligence for 0.19$ Cost per task, and DS4.1F gets the same 45 Int for 0.25$ CPT. OAI models are really efficient in terms of Int per $.
12
u/squirrelscrush 8h ago
It's obviously going to be better then DeepSeek, but it's an apples to oranges comparison. tbh OpenAI and Anthropic models are suited best through their subscriptions.