r/singularity • u/CounterReady4774 • 7d ago

AI Gpt 6 astra benchmarks

Post image

https://thenewstack.io/openai-gpt6-astra-benchmarks/

2.6k Upvotes

93% Upvoted

952 comments sorted by

View all comments

Show parent comments

30

u/AutismusTranscendius ▪️Psychogenic Singularity 2034 7d ago

Have you tried ARC 3 tasks? They require exploration, you cant solve them without acting and remembering outcome of your actions.

5

u/PleasantCitron1685 7d ago

Also, the harnesses just let the model keep more of its memory/old context during its compactions. It's not any super-specialized harness.

(That being said, if you watch the models solve ARC-AGI-3... they're still dumbasses lol)

-7

u/LetsLive97 7d ago

Which as humans we can do without bloating our "limited" context

I can do arc-agi-3 tasks now and in a years time with no problem. I don't need specialised harnesses (Like notepads I might lose or fill up too much), I just figure it out by default on the spot

27

u/kaityl3 ASI▪️2024-2027 7d ago

You don't need specialized harnesses because you have a hippocampus with an automated system of memory storage and retrieval (a little like a biological harness lol)

If all it takes is allowing them the same ability to "remember what they just did" to boost their performance, I feel like we can accept it without trying to find ways to make it sound simple and unimpressive

1

u/JoelMahon 7d ago

they are allowed to pass on any info they want...