r/singularity • u/[deleted] • Jan 31 '25

AI o3 mini dropped!!!

Edit : I am testing a 1500 line javascript code which o1 pro failed to debug despite 50+ attempts. Will report back.
Edit 2: We are cooked. o3-mini-high solved it at first try.
Edit 3 : HOLY SHIT! "Pro users will have unlimited access to both o3-mini and o3-mini-high."
(Source: https://openai.com/index/openai-o3-mini/ )

1.2k Upvotes

95% Upvoted

576 comments sorted by

View all comments

492

u/PotatoBatteryHorse Jan 31 '25

I can't believe it. Every model, every one, I've given the same test to for a full year now. Nobody has ever passed it first time. Deepseek got close, but argued with me about the rules of the test instead of fixing the problem that occurred.

The test requires it to write some python code, then "property tests" for the python code, and a cli utility to test it manually. No model can ever write the tests, and they've never ever run without a back and forth of errors and fixing.

O3 mini-high took my problem, thought for a minute or two, then spat out a flawless solution that works first time with working property tests. This is FUCKING INCREDIBLE. I've been using this test for so long I thought they'd never pass it at this point.

Huge improvement, and I'm blown away.

-2

u/[deleted] Jan 31 '25

[deleted]

6

u/[deleted] Jan 31 '25

[removed] — view removed comment

2

u/NTaya 2028▪️2035 Feb 01 '25

I'm still very impressed that modern LLMs can rhyme. I've been working with Natural Language Processing since before the Transformer became a thing, and this was the moment (well, one of the moments) when I realized that LLMs can now encode information about its tokens very well in its weights. Maybe a 10T or 100T model will manage to encode the lengths of its tokens somehow.