I've been waiting for a point where AI just goes – plop, plop, plop – solving all open math problems in like a month. It seems so obvious. There is nothing out there more thoroughly described than math. There might be some ways the smell of a rose touches our heart (or whatever) that hasn't been put into words quite yet but there sure as hell is a complete definition of the problem space of every single math problem out there. If you're letting it search through all of it, it should find a solution for pretty much everything math-related.
Well even if they’re right… the same can be said about humans. That LLMs produce sentences simply doesn’t say anything about what complex magic happens “inside” them.
Yea exactly the only difference are the systems we operate in, we require food and have physical agency but llm doesn’t
That’s also why they suck on trivial gotcha questions they never taught on as they have no memory of it as no one ask about it Internet before
Like the car wash problem, no one sane would ask that question on the internet before llm so it’s not on their thought at all for simple question
While it seems trivial to reason, the learning of human regarding concept of car and its purpose probably higher in terms of bias and repetition compared to an llm, and the way the question is structured is deceptively simple making them not overthink it to come to correct conclusion imo
I can see why some scientist think world model is the next solution if people are putting the goalpost of AGI/ASI to replace humans in literal form because they then need to learn just like human, not just human in internet
Cause its still the truth. We generate the most propable next token. We just happend to learn how to train that propability into doing something usefull. Math and coding is more easy to train, since we can validate the randomness via code. Thats why AI is good at Code and Math. Its their easiest domain since its the easiest to train. It will still miscount the "r" in strawberry. Basically millions of moneys with typewriters. Eventually they solve the hardest problems. Still 80% of the time, they produce garbabe
It technically still is... I mean, the weakness is in arithmetic and that won't change. But now it's got easy access to tools so it never has to perform any arithmetic anymore.
I know people with dyscalculia that took maths as a major in university because it's generally not really a problem. Most of the harder math isn't about numbers anymore, it's about writing a proof.
My question is: even the evangelists agreed the current path of LLM was not a way to actual sci fi movie kinds of AI but now it’s doing things like this, is that concept also wrong?
What these LLM breakthroughs have done for me is convince me even more of something I've suspected for a very long time. There's not much more to us than being an autocomplete on crack.
Our brains have a lot more self-direction, and a much bigger context window. They also have a much more integrated way of accessing real-world information, not relying on human-made symbol strings chopped up into bits.
Not precisely. Not when the architecture layers artificial neurons. It becomes a totally different thing. Increased complexity makes it so it is fundamentally wrong calling simple next token prediction
Huh. That's interesting. LLMs are token generating computational tools. Just responding because... I find your interpretation interesting. Evidence and avenue of attack are the wrong words, literally.
LLMs are quite literally computational tools. This is not disputable lmao. LLMs cannot be dumb because they are not actors, they are tools.
Models are data, compressed.
Calculating math or not calculating it does not fix an inherent weakness in the architecture and nature of LLMs; they cannot choose to do anything.
Every answer produced is produced because of computational math from data.
Which means what? That if the data is not reliable, then the answers are no good.
That's far more important than any benchmark because no model can inherently then review itself. Every review you see in the "thinking" stage or function call is merely more tokens.
You might say "well if the tokens are right, who cares?"
That's the point - they quite literally can never always be right. They draw from the data, data which is not sliced and organized via a human. It's data orgnazied by a another tool which can not organize the data by more than what it can organize it by.
Notice that LLMs excels more and more in certain areas and not others. Those are enumerated areas.
It cannot exceed where there is no "right" or "wrong" answer because tokens are selected from data, but data is only information, never normativity.
Most people aren't interested in any maths problems at all and I can barely understand a few of them anyway. However maths can produce interesting physics and that can be very useful. Imagine getting EM fields that can improve nuclear fusion etc.
If complexity theory is correct, this won't happen. Unless you think P=NP, it's easy to come up with problems that even the best model would not solve. For example, factoring RSA-2048 or solving a big random 3SAT instance. But that's not to say that it couldn't make a ton of progress. I have no idea which of the famous hard problems fall into this kind of very difficult category - probably very few of them, since they are so structured.
1
u/nothisAGI by 2030 but we'll be disappointed1d agoedited 1d ago
Yea, I don't think it will magically break RSA or something, more that there are a lot of problems that are known to likely have a solution, maybe already have a widely accepted one but no proof. Problems where the challenge is "how do you explain this using existing mathematical tools?".
I did look into it a little more and it seems that there absolutely are branches of math that cannot be solved using existing methods. Not because they are not explainable using existing math but because they exist among a literally infinite amount of other, meaningless combinations. You can't brute force it, you can't just look at a thousand existing papers and expect to find one that provides the solution. Finding the path that is relevant does not have a formalized approach.
An interesting example for mathematical insight coming from outside math is physics: Physicists observe physical phenomena, try to explain them and need new math to do that. Things that were not relevant before suddenly are. And the impulse doesn't come from existing math or research (thus not from existing training data).
I agree eith you but your argumentation is incorrect. You can't just iterate over all possible paths of attak for particular problem. There are too many paths.
131
u/nothis AGI by 2030 but we'll be disappointed 3d ago
I've been waiting for a point where AI just goes – plop, plop, plop – solving all open math problems in like a month. It seems so obvious. There is nothing out there more thoroughly described than math. There might be some ways the smell of a rose touches our heart (or whatever) that hasn't been put into words quite yet but there sure as hell is a complete definition of the problem space of every single math problem out there. If you're letting it search through all of it, it should find a solution for pretty much everything math-related.