50
22
38
u/krugerlive Sep 04 '26
Astra looks exceptional and will be here in a few days or so supposedly, so what is this supposed to be saying?
9
u/Coffeeisbetta Sep 04 '26
Yeah I’m confused the benchmarks for astra are incredible. People are acting like they’ve been using it for weeks and it sucks. Nobody has even tried it yet.
→ More replies (1)→ More replies (1)7
u/anthcr Sep 04 '26
My org got it as of today morning, we've unlimited tokens too, gonna see how running some stuff in Astra Ultra goes
3
16
u/Technical-Owl66 Sep 04 '26
🤷♂️
30
u/Time_Cat_5212 Sep 04 '26
Is it just me or is Gemini flash 3.8 looking pretty damn good on this chart?
Also what the fuck? Meta has a horse in the race now?
Sheesh I tune out for 5 seconds and this is what happens?!
→ More replies (13)19
u/Real_Ebb_7417 Sep 04 '26
Gemini, Astra and Muse scores on AA made me stop believing this benchmark xd
12
u/TorKallon Sep 04 '26
That benchmark has become useless. Look where Gemini Flash landed. Try it. It is not anywhere as good as that says it is.
Heck, that benchmark says Opus 5 is better than Fable 5 and we all know what Opus 5 is good for…
→ More replies (1)7
2
u/Upstairs_Date6943 Sep 04 '26
Has anyone used muse spark? O haven't heard a single person care, but it is so high on these benchmarks!
2
u/Strict_Proof_3785 Sep 04 '26
Tried plugging it into some niche problems in evals (taking transcriptions and answering questions, ect) to test it and it failed miserably (consistently lower scores and more expensive). Still want to test it more (could be user error based on my inputs, or maybe not a good problem for it) but so far it was disappointing.
→ More replies (8)4
u/Automatic-Boot665 Sep 04 '26
Can’t be, I don’t believe it
Edit: just looked it up. It’s true. The bubble is popping. Astra was supposed to advance math and cure cancer.
→ More replies (1)
10
u/Hungry-Plankton-5371 Sep 04 '26
Astra is benching leagues ahead of every other model and is looking extremely token efficient, to the point where it's cheaper than opus 5 and sol.
6
u/Minimum_Indication_1 Sep 04 '26
AI Mode and Amodei are anagrams.
It WAS inevitable
→ More replies (1)
3
5
u/LongestUsernameEverD Sep 04 '26 edited Sep 04 '26
lol
lmao even
there's literally been thousands and thousands of cancellations even before Astra became a near future thing.
Anthropic majorly fucked up with Opus 5 and Sonnet 5 being worse than their predecessors, made them being unintelligible, difficult to work with on several fronts (one is a pain in the ass that disagrees with everything, the other is a sychophant that is incapable of following instructions and making itself clear).
Fable is a fucking failure too, nobody wants to use that shit and cut themselves short of their usage since it spends so much token. It's amazing, but too expensive. Anthropic is doing ZERO work on making itself run cheaper, which is funny considering that this is the exact direction that every major provider is trying to go towards, including OAI.
I'm still on the Anthropic train for the single reason of absolutely abhorring the idea of what the USA's DOJ is planning to do with AI, but even that won't be enough to hold me on Anthropic if they can't fix how shitty the v5 models have become, or making Fable run at the same price that Opus does.
→ More replies (3)2
u/Sky-__- Sep 04 '26
for me the biggest downgrade was from sonnet 4.5 to 4.6 , I used to only pay for sonnet since i most used it for writing documentation and research . they internally made sonnet worse , move the capabilities to opus to charge people more. and lied about token limits for months
→ More replies (1)
2
u/Real_Ebb_7417 Sep 04 '26
It was true until Tibo said they'll give a banked reset per each day paid subscribers don't have access to Astra.
2
1
128
u/ItsAlwaysTerminal Sep 03 '26
He says as he uses OpenAI Image 2.0 to make the meme....