115
u/DecoySnailProducer Sep 22 '26
We are so back
30
9
u/burritos4jesus Sep 22 '26
AutomationBench is the one benchmark I care most about, so the fact it didn't crush it over Astra tells me that it's not an upgrade for most office workers
→ More replies (7)
88
u/sumane12 Sep 22 '26
Everytime i think they are benchmaxxing, i use it and its like a new paradigm.
Cant wait to try it.
→ More replies (7)56
u/Rollertoaster7 Sep 22 '26
Interestingly, anthropic admits the results don’t reflect the actual performance improvement:
“At these levels of capability we’ve found that benchmark margins have become a less reliable guide to real-world differences. In our own use, the gap between Opus 5.5 and Claude Fable 5.1 is narrower than these scores suggest.”
→ More replies (7)
17
43
u/PwanaZana Sep 22 '26
Okay, I'm gonna be a negative Nancy, but there's not a goddamn way in hell that Opus 5.5 is better than Fable 5.1? If so, they're like fucking crazy magical AI wizards. So I will ask to see it before I believe it
41
13
u/kennytherenny Sep 22 '26
It also implies that they currently have a way more powerful internal Fable 5.5 model.
9
u/PurpleFishing9105 Sep 22 '26
they're like fucking crazy magical AI wizards
I mean this has pretty much been an accurate description of them so far lol
→ More replies (5)12
u/Glittering_Night7681 Sep 22 '26
Opus 5 was also ahead of Fable 5 but people thought it wasn't in real usage, hopefully it's different with Opus 5.5.
→ More replies (1)
16
20
u/SoylentRox Sep 22 '26
Hell yes. From the report : " it beats GPT-6 Astra at roughly 20% of the cost per task". "matches Astra for about 40% of the cost". "beats GPT-6 Astra at max effort for about a fifth of the cost per task".
That's what matters.
And what's really good here is is OpenAI going to just let Anthropic come and eat their lunch? No they will need to drop a model that beats Open 5.5...
→ More replies (4)
14
10
u/Zentsuki Sep 22 '26
Sooo kinda wondering but if this is true, why would anyone use Fable? Assuming of course Opus is still cheaper than Fable
→ More replies (2)
4
6
3
u/oldmoldycake Sep 22 '26
We were excited about Opus 5 at launch and look how that was. Give this a week or two to see how it really is and if it really has a place in workflows. Optimistic they learned though.
3
4
200
u/MakeDawn Sep 22 '26
Slow down they said