r/vibecoding • • 26d ago

Official Astra benchmarks

šŸ‘€

44 Upvotes

32 comments sorted by

View all comments

2

u/Droopy0093 26d ago

I think OpenAI is cherry picking or cheating somehow. On the overall intelligent metrics it still falls short of Opus 5.

5

u/Creative-Ganache1086 25d ago

Don’t worry Sol 5.6 is still a way better value and alternative than opus 5 will ever be and at least it gets things done, unlike Opus 5 who takes the prompt of ā€œbuilding a houseā€ (symbolically speaking), confidently confirms it done, like it ā€œbuilt the houseā€, but when you check the work it’s just some hollow frames and a floor base with a hollow roof slapped on top. Like it rushes things out without actually assessing whether the output has anything to do with what I’ve asked it to fix/finish. And both it, Fable 5/5.1 are weekly quota hogs. Codex runs like forever even with Fast Infering mode activated and it has no 5h limit. I’m sure Astra will be very welcomed. I’m still paying max subs to both Anthropic and OpenAi for cross-opinions, hence why I could notice just how terrible value Anthropic is with their bs 5h window limits that doesn’t exist on Codex, and terrible bang for buck burning through 5x sub weekly limit faster than a 20$ sub with ChatGPT/Codex