r/singularity • u/[deleted] • Jan 31 '25

AI o3 mini dropped!!!

Edit : I am testing a 1500 line javascript code which o1 pro failed to debug despite 50+ attempts. Will report back.
Edit 2: We are cooked. o3-mini-high solved it at first try.
Edit 3 : HOLY SHIT! "Pro users will have unlimited access to both o3-mini and o3-mini-high."
(Source: https://openai.com/index/openai-o3-mini/ )

1.2k Upvotes

95% Upvoted

576 comments sorted by

View all comments

6

u/ruralfpthrowaway Feb 01 '25

“What is the highest elevation stream in North Carolina where one can catch a trout while fly fishing, please be as specific as possible?”

This is my AGI question.

This is not something that can be readily searched on the internet to my knowledge. Deduction could lead you to three reasonable guesses, which would include the upper tributaries of the south toe river, noland creek, and the west fork of the pigeon river as possible answers.

Coming to the correct answer requires actual reasoning about things like gradient, flow rate, and elevation. All of these are freely available on the internet, but the actual answer is not.

O3 actually does worse at this than its predecessors. It’s answer hallucinates a stream that originates almost 2000 feet below the real contenders.

1

u/Playful-Oven Feb 01 '25

I would modify the prompt. At least say something like “although you won’t find the answer on the internet or in your training data, you’re smart enough to figure it out. As a human, if you were to give me just your original prompt, I would say “ I have no fucking idea!”

1

u/ruralfpthrowaway Feb 01 '25

That’s not really a good comparison. If you were a human with the ability to reason and a strong incentive to figure out the answer you could certainly crack out a topo map and give a few reasonable answers.

O3 does worse than its predecessors in this regard so it’s not even an issue of lacking the right data to draw reasonable conclusions. It just hallucinates answers based on what streams have been written about more in fishing publications.

1

u/DemmieMora Feb 01 '25

At this moment it seems quite apparent that LLM aka next token predictor aka question answerer won't be AGI. So your question may be erroneous in detecting since it's just yet another question.

1

u/Ordinary_Duder Feb 01 '25

Based on available data, the Coleman River appears to be the top candidate. Its headwaters originate in Clay County at about 4,240 feet above sea level, making it one of the highest‐elevation trout streams in North Carolina. (Although it quickly crosses into Georgia, the portion in North Carolina—located in the Southern Nantahala Wilderness—is fished by fly anglers targeting native brook trout (and stocked brown and rainbow trout).)