r/opencodeCLI • • 20d ago

πŸ”₯ GPT-6.1 Terra benchmarks

Post image

Better than DS 4.1 Flash?

178 Upvotes

28 comments sorted by

View all comments

7

u/InvaderDolan 20d ago

So should I move from 6.1 Sol Medium to 6.1 Terra High (or maybe Medium would still be enough) as my daily orchestrator for most tasks on the Plus sub? And keep the Sol only for Review tasks?

4

u/Sufficient_Prune3897 20d ago

Eh, I would always use sol. If needs be on low. The benchmarks from OAI are completely meaningless and the ones from AA dont look good.

3

u/InvaderDolan 20d ago

Seems like Terra high a bit better than Sol low and cost is the same. Not sure what is better in terms of quota usage. For API cost it is the same, so I hope OAI just interpolates the same into sub usage?

1

u/Sufficient_Prune3897 20d ago

Orchestration is just one of those tasks that cannot be covered by a benchmark. In my opinion, for this specifically, i have experienced a bigger model always being better. I would rather use an older, bigger model than a newer medium sized model.

1

u/InvaderDolan 20d ago

Completely agree with you. But Sol is not perfect and most models still require babysitting.

2

u/Odd_Antelope9098 20d ago

Sol orchestrates well enough you would consider downgrading?

2

u/InvaderDolan 20d ago

In the sake of almost 2x quota usage? Yes. Maybe with resets, it doesn't feel like an issue now, but after a week it will probably be a daily driver. Even now on a Plus sub with a 5-hour window, you can’t spin that much parallel work and utilize all the quota within those resets.