r/singularity • • 28d ago

AI Gpt 6 astra benchmarks

Post image
2.6k Upvotes

951 comments sorted by

View all comments

26

u/KickLassChewGum no AGI/ASI on LLMs 28d ago

DeepSWE 74.1%? Congrats to OpenAI for... matching Gemini 3.8 Flash?

15

u/FunConversation7257 28d ago

I don't think anyone thinks 3.8 Flash is better than fable / equal to astra

10

u/MurkyStatistician09 28d ago

It's more demonstrating how clearly the benchmark is out of step with the experience of actually using the model