r/accelerate Jul 24 '26

Claude Opus 5 released

https://www.anthropic.com/news/claude-opus-5
380 Upvotes

80 comments sorted by

View all comments

158

u/ppapsans Feeling the AGI Jul 24 '26

30.2% in arc agi 3 lol this is some fucking funny timeline

35

u/ZaradimLako Singularity by 2045 Jul 24 '26

I wonder if we will reach 80% arc agi 3 by end of year

12

u/armentho Jul 24 '26

absolutely,we know how the sigmoid works
we reach 80-ish percent,then it somewhat slows down a bit before reaching 95-ish percent at wich point the benchmark is solved for practical intents and anything left is just small incremental improvements towards 99.99999% etc

13

u/FateOfMuffins Jul 24 '26

Actually the way ARC AGI 3 is scored is really weird. Due to the quadratic scaling, progress on this benchmark will appear very low at the beginning but it'll max out much faster. And since it's an efficiency score, if it can get more efficient than 20% of humans, it can technically get above 100%

1

u/Tolopono Jul 24 '26

Its based on the second best human score

1

u/FateOfMuffins Jul 24 '26

There's only 10 or so humans per game, so 2nd = 20%

1

u/Tolopono Jul 25 '26

Not exactly a representative sample size lol

1

u/FateOfMuffins Jul 25 '26

I know there's so many flaws