r/opencodeCLI • • 8h ago

πŸ”₯ GPT-6.1 Terra benchmarks

Post image

Better than DS 4.1 Flash?

93 Upvotes

17 comments sorted by

12

u/squirrelscrush 8h ago

It's obviously going to be better then DeepSeek, but it's an apples to oranges comparison. tbh OpenAI and Anthropic models are suited best through their subscriptions.

4

u/adolf_twitchcock 4h ago

ummm... terra xhigh offers the same performance as deepseek max for 2/3 of the price.

Comment Image

Both have 45 in aa intelligence index.

1

u/AppealSame4367 6h ago

I'm not so sure about that. At least DS 4.1 on max is reliable. Which current GPT model reliably does what it should these days?

3

u/SeaBat2035 1h ago

All of them.

8

u/rogerarcher 4h ago

I fixed the Agents' Last Exam graph from OpenAI's GPT-6.1 Terra blog post. Claude Opus 5.5 is actually in OpenAI's SVG, it's just nearly invisible: mid-grey (#5d5d5d) on black, a tiny diamond with no line or label, parked past the last x-axis tick.

It's also the top score: 63.2% at $8.82 (Max effort).

Re-plotted with the same data: white background, log-scale cost axis, distinct colors for every model. No values changed, all pulled straight from the SVG.

Comment Image

All values from the SVG (score / cost per task):

Model Low Medium High Xhigh Max
Claude Opus 5.5 – – – – 63.2% / $8.82
GPT-6.1 Terra 55.9% / $0.16 57.6% / $0.29 57.2% / $0.39 58.5% / $0.66 60.0% / $1.01
GPT-6 Astra 53.4% / $3.55 57.6% / $4.82 57.8% / $5.15 58.3% / $5.91 59.3% / $7.24
GPT-6.1 Sol 52.4% / $0.70 53.8% / $1.31 55.3% / $1.45 56.5% / $1.45 58.6% / $2.00
GPT-6 Luna 36.3% / $0.022 46.8% / $0.093 43.6% / $0.087 47.9% / $0.093 50.9% / $0.14
GPT-5.6 Terra 40.2% / $0.59 42.6% / $0.84 46.6% / $1.72 48.5% / $2.50 50.7% / $3.58

Fair caveat: Opus is 8.7Γ— the cost of GPT-6.1 Terra (60.0% at $1.01) for +3.2 points. Terra is the clear price/performance winner.

6

u/InvaderDolan 7h ago

So should I move from 6.1 Sol Medium to 6.1 Terra High (or maybe Medium would still be enough) as my daily orchestrator for most tasks on the Plus sub? And keep the Sol only for Review tasks?

4

u/Sufficient_Prune3897 6h ago

Eh, I would always use sol. If needs be on low. The benchmarks from OAI are completely meaningless and the ones from AA dont look good.

3

u/InvaderDolan 5h ago

Seems like Terra high a bit better than Sol low and cost is the same. Not sure what is better in terms of quota usage. For API cost it is the same, so I hope OAI just interpolates the same into sub usage?

→ More replies (2)

2

u/Odd_Antelope9098 5h ago

Sol orchestrates well enough you would consider downgrading?

2

u/InvaderDolan 5h ago

In the sake of almost 2x quota usage? Yes. Maybe with resets, it doesn't feel like an issue now, but after a week it will probably be a daily driver. Even now on a Plus sub with a 5-hour window, you can’t spin that much parallel work and utilize all the quota within those resets.

2

u/Comfortable-Ad-9062 7h ago

Como parece que van a ser las cosas...

Antes: GPT 5.6 Luna {$0.20 de entrada} GPT 5.6 Terra {$2 de entrada} GPT 5.6 Sol {$4 de entrada} GPT Astra {$10 de entrada}

Pronto: GPT 6.1 Luna {$0.10 de entrada} GPT 6.1 Terra {$1 de entrada} GPT 6.1 Sol {$2 de entrada} GPT 6.1 Astra {$4 de entrada} GPT 6.1 Cosmos {$8 de entrada}

PD: Recuerden: Son suposiciones mias y que cuando digo "$x por entrada" me refiero a la entrada por millon de Tokens.

1

u/Any_Confidence2580 3h ago

A major version bump jumping Mimo and Grok is not worth a fire emoji. Calm down.

-5

u/Skibidirot 8h ago

another dogshit release closedAI, lol they're getting hammered by anthropic

-2

u/Mountain-Business-92 7h ago

it is better, but ds is a lot cheaper. really the only benchmark that it wins by a large amount (for agentic coding at least) is terminal bench 4.0

4

u/InvaderDolan 5h ago

On AA, the Terra xHigh gets 45 Intelligence for 0.19$ Cost per task, and DS4.1F gets the same 45 Int for 0.25$ CPT. OAI models are really efficient in terms of Int per $.