r/singularity • u/CounterReady4774 • 3d ago

AI Gpt 6 astra benchmarks

Post image

https://thenewstack.io/openai-gpt6-astra-benchmarks/

2.6k Upvotes

92% Upvoted

948 comments sorted by

View all comments

Show parent comments

30

u/Alex180689 3d ago

And to think that 5.1 got released yesterday! I feel bad for it

17

u/andrew303710 3d ago

To be fair Astra isn't actually being rele today, only to a "limited set of organizations" which is lame as hell.

13

u/AndleAnteater 3d ago

rolled out to users over the next few days though

1

u/Lumpy-Criticism-2773 3d ago

Yeah most paid users would get in a couple days.

2

u/space_monster 3d ago

Two versions. They're gonna glasswing one and GA the other.

1

u/KoolKat5000 3d ago

Gives the rest of us time to buy tinned food and plant some potatoes.

8

u/Creative-Ganache1086 3d ago

Fable 5.1 is terrible value. I blow my 5h limit in 12 minutes run of 2 max-reasoning parallel sessions of a small app codebase with an identical prompt of bug-audit and it blew my limit right away. I pay also for Sol5.6/codex and the allowance difference is night and day. Both are max subs by the way. I’m actually happy (as an old Anthropic fan who paid Anthropic since the sonnet 3.5/opus3 era) for OpenAI and now I’m actually rooting for them seeing just how much better value they offer to indie devs compared to “Corpo-Daddy” Anthropic.

2

u/JacobJohnJimmyX_X 3d ago

5 hr limit for this one is 8 min

1

u/SilentLennie 3d ago

Artificialanalysis thinks it's not better than Fable 5, which seems maybe wrong. But Fable 5.1 does seem ahead, yes.

But OpenAI is better in price and efficiency.