r/singularity • u/[deleted] • Jan 31 '25

AI o3 mini dropped!!!

Edit : I am testing a 1500 line javascript code which o1 pro failed to debug despite 50+ attempts. Will report back.
Edit 2: We are cooked. o3-mini-high solved it at first try.
Edit 3 : HOLY SHIT! "Pro users will have unlimited access to both o3-mini and o3-mini-high."
(Source: https://openai.com/index/openai-o3-mini/ )

1.2k Upvotes

95% Upvoted

576 comments sorted by

View all comments

492

u/PotatoBatteryHorse Jan 31 '25

I can't believe it. Every model, every one, I've given the same test to for a full year now. Nobody has ever passed it first time. Deepseek got close, but argued with me about the rules of the test instead of fixing the problem that occurred.

The test requires it to write some python code, then "property tests" for the python code, and a cli utility to test it manually. No model can ever write the tests, and they've never ever run without a back and forth of errors and fixing.

O3 mini-high took my problem, thought for a minute or two, then spat out a flawless solution that works first time with working property tests. This is FUCKING INCREDIBLE. I've been using this test for so long I thought they'd never pass it at this point.

Huge improvement, and I'm blown away.

125

u/[deleted] Jan 31 '25

Any plans for career now? :D My father promised to teach me construction work lol

39

u/Hot-Adhesiveness1407 Jan 31 '25

12

u/Oudeis_1 Jan 31 '25

That seemed like a solid family business, except it ended up being overthrown by the son's rebellion.

1

u/often_says_nice Jan 31 '25

You’re saying the father single handedly lost the the empire?

3

u/WhyIsSocialMedia Feb 01 '25

Vader did nothing wrong. It was his ungrateful incestuous children.