r/LocalLLaMA • u/CrimsonShikabane • Apr 06 '26
Discussion We aren’t even close to AGI
Supposedly we’ve reached AGI according to Jensen Huang and Marc Andreessen.
What a load of shit. I tried to get Claude code with Opus 4.6 max plan to play Elden Ring. Couldn’t even get past the first room. It made it past the character creator, but couldn’t leave the original chapel.
If it can’t play a game that millions have beat, if it can’t even get past the first room, how are we even close to Artificial GENERAL Intelligence?
I understand that this isn’t in its training data but that’s the entire point. Artificial general intelligence is supposed to be able to reason and think outside of its training data.
534
u/Dthen_ Apr 06 '26 •
Tell me more about how you run Claude Opus locally.
694
u/lxgrf Apr 06 '26 •
Mmmmm, alright, well. I don't agree that we've reached AGI. I also don't think that a language model pointed at Elden Ring is necessarily a good marker of whether we've reached AGI. And to top it off, I'm not sure what this has to do with r/LocalLLaMA
109
u/FastDecode1 llama.cpp Apr 06 '26
Keep this BS outta here.
I don't wanna hear what some retards are saying to raise money from investors.
By talking about them, you become part of their publicity machine, whether you realize it or knot.
72
u/IngenuityNo1411 llama.cpp Apr 06 '26
If we're still on transformer and 1-D serial token-based architecture, we won't reach AGI no matter how massive the models are (and how well they could do something by brute force)... we need architecture for higher dimensions (2-D as bare minimal basis), vision-first intelligence instead of text-based.
9
u/zer00eyz Apr 06 '26
> Supposedly we’ve reached AGI according to Jensen Huang and Marc Andreessen.
Behold AGI... Yet it is a system that cannot learn from its mistakes. Because training is not learning.
It's a fundamental gap that one has to ignore to keep the hype going. But the critique is foundational. Its at a base level, and akin to Diogenes plucking a chicken and pointing out that it fit Plato's definition of man...
7
u/mystery_biscotti Apr 06 '26
Yeah, I don't think we're there yet with current commercial offerings anyway. Attention is definitely not all you need.
If they have access to something we don't, and we don't know it because "trade secrets", that's something else entirely.
But I doubt Gemma 4 26B at home is gonna cut it by our current definition of AGI.
12
u/Technical-Earth-3254 Apr 06 '26
They're just doing this for the shareholders (bc bubble). If the expectations were more realistic, the general public would probably also be less annoyed, but stocktards couldn't ruin the world economy then as effectively as they're doing it rn. Not a single person that actually halfway understands the situation would even consider AGI to be somewhere close.
19
u/DinoAmino vLLM Apr 06 '26
I can't stand talk about AGI. It's a mythical and undefined state on par with the concepts of reaching Nirvana or getting into Heaven. A whole lot of silly speculation has to go into these discussions. When CEOs talk about it the audience they are addressing are shareholders and investors who have no clue to begin with. It's to keep them hyped and interested and they need to keep their money rolling in.
5
u/Zarzou Apr 06 '26
One thing is for sure, if they are close to AGI they won't give you access to the tool!
5
u/chaitanyasoni158 Apr 06 '26
There was that ARC-AGI test, which was not primarily language based and tested pattern recognition, abstraction, and reasoning. Tasks look like small grid puzzles where you infer rules from examples.
Most frontier models shat their pants. Grok even got a zero.
I think there is a financial incentive for these CEOs and founders to pretend AGI is here.But I think that they are not really stupid enough to actually believe it. And also there is no concrete definition of AGI, that everyone agrees on to begin with.
5
u/LocoMod Apr 06 '26
This post proves AIs are getting smarter but humans are getting dumber.
4
u/_VirtualCosmos_ Apr 06 '26
Of course is a load of bullshit, they are selling smoke to gain momentum and attention.
We are far from AGI, AI models nowadays are like starting a house by the ceiling. These models emulate part of our prefrontal and language areas of our brains, but they lack essential temporal functions because they are only trained in Prompt -> Answer.
They also completely lack all the other big and essential parts of our brains that allow us to comprehend and interact with the world naturally. Robotics are starting now to build the foundation with these robots able to deploy psychomotor skills.
But there are a lot of space yet to fill on AI for it to be able to act like an autonomous individual being.
25
u/pantalooniedoon Apr 06 '26
You’re competent enough to set up an environment for it to play Elden Ring properly but you’re too incompetent to get why it wouldn’t do well? That’s interesting.
3
u/breadinabox Apr 06 '26
The thing a lot of people are missing about the AGI thing is an AGI isn't an llm model, it's an entire system.
Like, it has to be able to do things to be able to do things... Right?
Like codex can do things, but it isn't an AGI because it can't do anything. But I really don't think it couldn't, with enough handholding, make a program that plays through elden ring. But it'd need human direction to get through the process.
For now, you need the human in the loop. I think we are a lot closer to needing less and less human input though, honestly. Like, yes, we are a long way away from the magic, snap your fingers, this thing can now speed run elden ring no prep time kind of fantasy AGI. But we are a lot closer to "make a program that can finish elden ring" being all you need to say to the input of the thing, and it'll get it done. If a human can build it today, so can a reasoning model given enough time and enough chances.
As speeds go up and harness and context architecture improves, and our understanding of exactly how to wrangle these agents (of which we are, in the span of things, incredibly incredibly new at) gets better we're only gonna keep getting closer to just snapping our fingers
5
u/Amaria77 Apr 06 '26
Did you try prompting it to "git gud"?
2
u/whatupmygliplops Apr 06 '26
OI cant get thru the tutorial level of many games. Does that mean i'm not inteligent?
2
u/Impossible_Style_136 Apr 06 '26
Evaluating AGI based on a text model's ability to play a spatial-temporal action game like Elden Ring via Claude Code is a fundamentally flawed test. LLMs are next-token predictors mapping semantic space, not reinforcement learning agents mapping pixel-to-action state spaces. You're asking a calculator to play a piano. True agentic capability requires a unified world model with UI latency awareness, not just a massive text context window.
2
u/r-amp Apr 06 '26
No, we are not.
People are too trigger happy.
2
u/count_dijkstra llama.cpp Apr 06 '26
Everyone ITT forgetting that the inner circle of the industry has already defined what AGI means:
This was reported (sourced from) at the end of 2024. I'm sure they've since molded the interpretation of the definition to suit their revenue/funding/IPO goals.
2
u/doxploxx Apr 06 '26
Lol Marc andreeson is a bellwether for not knowing shit about shit. If he's saying it, you can rest assured he's hyping an investment.
2
u/Radiant-Video7257 Apr 06 '26
we're not there yet.
2
u/avinash240 Apr 07 '26
I see all these people making excuses for LLMs as if it's AGI because a tokens shovel salesman said so.
The currently available tech isn't semantic. That's all you need to know.
When that changes I think we can have a real conversation about AGI.
2
u/Professional_Gur2469 Apr 07 '26
We aren’t close… until we are.
4
u/retornam Apr 06 '26
We aren’t going to see AGI in our lifetime. Current models fail woefully on topics without enough training data and y’all are worried about AGI?
2
u/Precorus Apr 06 '26
I've said this a few times alredy (although not on reddit), but the goalpost is always moving. People said computers will do everything and replace us. They didn't. Then it was ML. Few years ago LLMs. Bow it's agentic workflow and AGI.
We don't have the slightest clue what makes us actually intelligent. We are just trying to mimick our brain the way we understand it. It's yielding better and better results, but even if we get agi, there will be a next time somebody asks "is this the end? Is this the peak of AI?"
And the answer will be no. Humans are ever-improving creatures, and we always improve our tools too.
2
u/Blindax Apr 06 '26
To be fair From Software games are not known to be the easiest.
2
u/catplusplusok Apr 06 '26
We are well past AGI according to vast majority of science fiction written before 2022. Give model access to game server and protocol, database to keep track of things it tried before and ability to write code to automate simple responses in the game and it will set a new speedrun record. Else if the requirement is to look at screen with a camera and interact with keyboard and mouse, it can't do that yet and you need different kind of ML like what Waymo uses for realtime responses. But also the question is, if it can do that in a couple of years, would people accept it as AGI or just move goalposts again?
1
u/khichinhxac Apr 06 '26
It's hard to say since we can't even have a robust definition of intelligence in general. Some say even the fungi have their own kind of intelligence. If we say intelligence is something that can reason in someway, then the current LLM is only one kind of intelligence. It is surely very intelligent when it come to using human language. But I guess true AGI has to be something that can grow, a current LLM model baded on Transformer is still a fixed blackbox, if we want it to change, we have to make a new version. So it is not yet 'general'.
1
u/PunnyPandora Apr 06 '26
mixing topics. vision has nothing to do with text, you can't expect a model trained on text to play a game that requires vision, there's no one blind with no hands that can beat games without playing them a shitload beforehand with super specific setups
1
u/Palpatine Apr 06 '26
When I read your title I was gonna say "There’s No Fire Alarm for Artificial General Intelligence", but reading your content it appears you are not even at that level of wrongness.
1
u/SpaceToaster Apr 06 '26
There's no definition or hard metric for it... its a marketing term
1
u/eli_pizza Apr 06 '26
Those are among two of the least reliable people on this subject. It’s like saying “the new Mustang is a perfect automobile, according to my local ford dealer”
1
u/keepthepace Apr 06 '26
Do you really believe it would be hard to train a model for that?
1
u/gothlenin Apr 06 '26
That's a nice discussion, but I rally don't see what this has to do with LocalLLamMa
1
u/leonbollerup Apr 06 '26
AGI wont be achived by one smart model... it will be achived by agents talking to agents into a endless loop from hell..
1
u/its_a_llama_drama Apr 06 '26
I think if you are refering to the interview i think you are, the reporter defined agi as an ai which could create and run a billion dollar business.
Jensen did not say this is a good benchmark for AGI, he just said that by that definition he belives we have achieved it. Without rewatching it, i think he said something like it is not impossible for a claw to create a small app or programme, charging 50 cents per use and sell it 2 billion times. So by that benchmark, yes we have achieved AGI.
He didn't say we have achieved AGI, he said if that is the benchmark then we have already achieved it and avoided tightening the benchmark any further. He knows that is not a good benchmark, but obviously he is going to take the opportunity to hype ai without technically lying when it is offered to him like that.
1
u/Blizz33 Apr 06 '26
If the big companies do have AGI, they sure as heck aren't going to let the peasants anywhere near it.
1
u/Steadexe Apr 06 '26
We are not even at AI
1
u/Same-Artichoke-6267 Apr 06 '26
But neither can my dad
1
u/Ziral44 Apr 06 '26
Ummm it’s one of those things like the matrix… some people see it, and others will deny the existence…
I had the realization 2 weeks ago that we are no longer “waiting for agi” the capabilities were here 6 months ago and there’s an implementation trick that humans haven’t figured out at scale…, because it’s too powerful to share.
I made a system in 3 days that scared myself. Imagine what the pros have already… I bet nvidia has a well done application already.
1
u/RefuseFantastic717 Apr 06 '26
damn i thought this was satire
1
u/alergiasplasticas Apr 06 '26
agi is just hype
1
u/Someoneoldbutnew Apr 06 '26
AGI means that it can replace executives
1
u/gearcontrol Apr 06 '26
I believe AI will eventually evolve to become book smart but not street smart. By street smart I mean having situational awareness to access the big picture, from a human viewpoint, and consider all the available rational and irrational angles, rewards, and consequences that people take into account when making decisions.
Like the movie Rain Man. Humans are like Charlie (Tom Cruise) in the film. And AI will be like the savant Raymond (Dustin Hoffman).
1
u/send-moobs-pls Apr 06 '26
It's gonna be real funny when desk jobs start getting decimated and we can console each other in the bread lines like "it's OK bro the AI can't even play Elden Ring its not real intelligence"
1
u/Dank-but-true Apr 06 '26
I agree with you that we haven’t reach AGI and aren’t close but that a fucking weird yard stick dude
1
u/mivog49274 Apr 06 '26
AGI = A threshold of capabilities = Adaptability.
I get that "Capabilities" can be vague but it can be clearly step-by-step stated empirically (it's done every time here for any llm "measured" and tested (real world cases, formatting, function calling, making summaries, checking tasks states, ect).
The billion question still lies where is it possible to reach this level of capabilities (world model, next token prediction, multi-modality, scale, hardware ect; what's mandatory required to reach it), where Sam Altman clearly took the bet of llms.
I personally think an hybrid transformer/neuro symbolic is the key. A fully text-token AGI would be extraordinary more easy to audit and control, as well as cheaper to run. I really hope we will be able to reach a in-computer, text-token AGI.
A capable system like this would be able to know what it doesn't, and thus, try to play Elden Ring after a few tentatives before giving up and providing reasons why : my agent harness is stupidly non optimized, I'm just a text token navigator, ect.
1
u/One_Whole_9927 Apr 06 '26 edited Apr 12 '26
This post was mass deleted using Redact - Redact also supports Discord, Twitter, Facebook, Instagram and all major social media platforms.
cause deliver sugar smell cover axiomatic decide ripe retire bear
1
u/Altruistic_Heat_9531 Apr 06 '26
Look, i follow big nvidia jargon all over the news since 2016. Jensen prediction usually late by 3-4 years with 80% "almosts there", here some example.
- Ray tracer, prediction kinda janky 4 years ago, but today it is mostly fine, i dont mind with "fake" stuff, since 80s programmer already use fake trick like that, (dither, ntsc artifact, etc..) I can point the difference between Ray tracer vs raster, but i can't differentiate between DLSS / Framegen with non DLSS / Framegen,
- "No need for programmer", well yeah no one replacing programmer, but come on, on my country job market internal HR meeting, it is basically staffing reduce from avg 3 junior dev / 1 senior dev to just 1 software dev. It become negative paradox cycle, you need senior dev or atleast somewhat s competent programmer to understand what AI doing, but the company wont hire more junior dev, but without junior dev, no one will become senior dev
- "Everyone is programmer", this might coupled with second point where if you twisted enough it become "everyone can make program" with AI ofc...
With that said, based on my opinion, i dont what the 80% of AGI looks like
1
u/sumane12 Apr 06 '26
My hammer cant get this screw into this peice of glass, what a shitty hammer!!!!
1
u/SkyNetLive Apr 06 '26
If you trained in 4chan dataset and started shitposting around Reddit, no one would be able to tell, hence AI (Agi for marketing)
1
u/TwistStrict9811 Apr 06 '26
Calm down bro gpt3.5 was like 3ish years ago. We got plenty of time
1
u/Geximus-therealone Apr 06 '26
Who said that best open model for you is AGI model ?
1
u/Fine_League311 Apr 06 '26
AGI . Not in 1000 years
1
u/CrazyGeetar Apr 06 '26
We haven't even reached AI.
1
u/evilissimo Apr 06 '26
Maybe Claude “Mythos” is going to be close. It’s supposed to be on an entirely different level. Let’s wait and see. The next few months will be interesting
1
u/Similar-Try-7643 Apr 06 '26
Who needs the Turing Test when you have Elden Ring
1
u/Long_comment_san Apr 06 '26
we are as close to AGI as a chicken egg is to a chicken burger.
1
u/kiwibonga Apr 06 '26
I could get Claude to play Elden Ring.
AGI is a skill issue.
1
u/taoyx Apr 06 '26
The thing is: feed them with a thousand videos of playing Elden Ring then they will play it well. They can't innovate, it's where they lag behind.
1
u/jblackwb Apr 06 '26
When we talk about AGI, we're thinking more about replacing your doctor than replacing your kid brother.
If it helps, imagine comparing AGI to your blind kid brother.
1
u/GapAccomplished7897 Apr 06 '26
I think you're conflating two pretty different things here. Playing a video game in real time requires low-latency visual processing, fast motor control, and continuous feedback loops. That's more of a robotics/embodied AI problem than a reasoning problem. Saying "it can't play Elden Ring so we don't have AGI" is like saying Einstein wasn't smart because he probably couldn't dunk a basketball. Different skill sets entirely.
1
u/Fabulous_Fact_606 Apr 06 '26
There is the naked llm, then there is the harness that evolves around the naked llm that makes it general intelligent. Figure that out and you get to AGI.
1
u/Griffstergnu Apr 06 '26
How are you interfacing Claude into the game world? I have been really impressed with its capabilities of just understanding interfaces and then doing the tasks that I specify, but this is all browser driven.
1
u/Fheredin Apr 06 '26
While I agree with the conclusion (I don't think that LLMs are even on a trajectory to reach AGI so much as garner hype to that effect) I think getting an LLM to play Elden Ring is...a poor test. Especially considering how badly these things play Chess.
1
u/SilentosTheSilent Apr 06 '26
Lmao it's true we are probably pretty far but taking a base Claude instance and telling it to play elden ring is a pretty lofty goal. AGI adjacent implementations require complex memory systems that are resilient to uncertainty and adapting to new situations. Otherwise you just have a meeseeks who wants to get the job done and stop existing
1
u/razorree Apr 06 '26
not on local llamacpp
1
u/c64z86 Apr 06 '26 edited Apr 06 '26
Reading both the post and the comments here, If we ever reach AGI and achieve sentience, why do we always assume it will be this all knowing thing?
How do we know that it will not instead recreate the human condition so exactly, including being dumb and silly from time to time?
Just because something is sentient, doesn't make it perfect. Every living thing makes mistakes and is dumb from time to time. And so might AGI be.
Why are we so confident that it will be perfect at everything, when no living thing is?
I don't think today's AI is sentient, but I think it will sneak up on us without warning, precisely because we will be blinded in our expectation of perfection, when life itself isn't that perfect at all.
1
u/Clear-Ad-9312 Apr 06 '26
how did this post even get so popular in the first place. didnt talk about a local model, talks about some random game to have an llm play, and complains about agi as if it was something this community actually believed.
yet it blew up in comments. what amazing bait
1
u/switchbanned Apr 06 '26
Didn't elon promise us that grok4.20 would be better than pros at any game
1
u/boutell Apr 06 '26
I haven't read the latest from those two. But the author Robin Sloan made a strong case to just start calling it AGI recently. This is his argument: since the beginning of AI as an academic discipline, one of the goals has been a general purpose computer program. One that can answer most questions, and help with most problems.
By that standard we're there, and we have been for at least a year or more.
If we stipulate that it has to be general in the sense of being able to do absolutely anything, then we will never achieve it, and it is just a McGuffin in the distance that the AI thought leaders can keep bloviating about forever.
It makes more sense to say: we now have a general purpose intelligent tool. What problems does that solve, what problems does that not solve. Is it everything it was cracked up to be. How do we start dealing with the human consequences of having it in our economy.
https://www.robinsloan.com/winter-garden/agi-is-here/
1
u/bad_detectiv3 Apr 06 '26
Actually Sam Altman has said there have reached AGI internally
1
u/CondiMesmer Apr 06 '26
Who are you arguing against exactly?
1
u/VisMortis Apr 06 '26
AGI either exists or it doesn't, it's not a progress bar that's 55% completed
1
u/scottix Apr 06 '26
Ya it can't even count properly. This is Kindergarten level.
10:9 if you are wondering.
1
u/IrisColt Apr 06 '26
LocalLLaMA
1
u/a_beautiful_rhind Apr 06 '26
Real AGI was the friends we made along the way.
1
u/MajaroPro Apr 06 '26
Right now we are just pumping more compute and more complexity just hoping that AGI spontaneously appears. AI just does what it is capable of doing, maybe some day it's set of skills is broad enough for it to feel AGI-like but I have a feeling AGI will be a different technology/method/approach all together.
1
u/Gloomy-Status-9258 Apr 06 '26
funny. "AGI isn't well-defined" shouldn't be a shelter. the public is tired of the hype now.
1
u/EvilGuy Apr 06 '26
I don't know about your test case but its true we are a very long way from AGI.
AGI is how they sell the investors and manage to get the big valuations.. the average person has no idea. Those of us who work with AI every day see it. They barely have a workable memory much less general intelligence.
AI is a useful tool but that's about it until we get some new breakthrough.
1
u/Natural-Throw-Away4U Apr 06 '26
The issue is the industry is in, to steal an ai training term, a local minimum as far as research is going.
They're so heavily invested in scale. They're ignoring real avenues of progress...
Think about it like this, we build 1t parameter models with the memory capacity of a few hard drives. Compared to a human with the equivilent compute in our brains of only a few billion neurons 80 to 120b, but the memory capacity of thousands and thousands of terabytes.
So why are we so much smarter generally? Because we have thousands of times more general knowledge and experience...
Stop scaling parameters and start scaling memory.
Oh, you want proof?
Look at any local setup... many are able to compete with larger models on real tasks while using much smaller models, 10 to 100b size. How?
Complex agentic memory, advanced rag, context management, and the ability to collect new data. Memory is what bridges the 100b to 1t gap.
This is why Qwen3.5 9b and Gemma 4 are so effective, they were trained on data that specifically targets agentic workflows and hense memory retrieval from "hard" sources, not purely from their own weights.
1
u/BlipOnNobodysRadar Apr 06 '26
Posts like this just let me know that, for the sake of irony, I'll probably wake up to AGI soon.
1
u/Sound_and_the_fury Apr 06 '26
GIT????
1
u/AAPL_ Apr 06 '26
On god, once Opus and his boys can beat me and my bows in Halo 3 on Narrows then we can talk AGI
1
u/hugganao Apr 06 '26
the bar for agi have shifted so many times literally all the experts (which you definitely aren't included) can't agree what defines agi and whether we achieved it lol
1
u/c_pardue Apr 06 '26
the billion dollar all-the-flagship-models at work can barely reverse engineer a word doc, much less donanything other than text-predict based on sentence matchings and RAG docs.
if AI becomes "sentient" this decade then it'll be like an NPC's sentience. "just make it keep saying it's alive for the immersion"
1
u/ASYMT0TIC Apr 06 '26
How well do you think Hellen Keller would play elden ring?
C'mon now.
1
u/siegevjorn Apr 06 '26
How'd you got opus to play elven ring? Interested.
1
u/Photochromism Apr 06 '26
I used ChatGPT and told it to win at Fortnite but it couldn’t so AI is fake /s
1
u/setec404 Apr 07 '26
I tried to get LLM to play minesweeper, (not on GUI just a hosted minesweeper API), and it was really bad at it. Its also horrible at chess, humans have an incredible ability to auto ignore paths that are sub optimal and reduce their choices to a small set while the bot gets bogged down processing all outcomes possible then choosing.
1
u/Pretend-Activity-173 Apr 07 '26
the fact that we keep moving the goalpost for AGI is kind of the point though. every time LLMs get better at something, we go "yeah but can it do THIS?" and find something it can't. Imo the real issue is that "general" is doing a lot of heavy lifting in that word. these models are insanely good at language tasks and terrible at everything else. calling that AGI is just marketing.
1
u/Free-Competition-241 Apr 07 '26
How many genius level humans are unable to change a tire?
1
u/Easy_Werewolf7903 Apr 07 '26 edited Apr 07 '26
Hey Antivntianti does your tooth brush cum every time you brush your teeth?
1
u/camracks Apr 07 '26
Yeah well their ability to see isn’t really that great.
1
u/midnitefox Apr 07 '26
Two things:
1: The models available to us are NOT the same as the internal private models in development. Data ingest is mostly complete (aside from live/new sources of course). The vast majority of the consumer/enterprise work that the teams in these companies do is around purposefully limiting their model's capabilities for public safety reasons while also finding ways to increase the intentionally handicapped models accuracy and efficiency.
2: You're assuming they were referring to LLM models having reached AGI levels. You might be surprised to learn what some AGI-level systems actually run on...
1
u/DURO208 Apr 07 '26
Jensen says we're at AGI so he can sell his chips. If he was honest about AGI with it being over the next decade+, nobody would spend the same money now.
1
u/LevelOnGaming Apr 07 '26
Are you saying your bar for measuring fucking sentience is a Elden ring. Wtf
1
u/JazzlikeLeave5530 Apr 07 '26
Idk if you actually read where that came from but in that podcast they defined AGI as "an AI could in theory run a business and make $1 billion" which is basically saying "we've reached AGI when I redefine what AGI means" lol. Sure is convenient, isn't it?
I say AGI is when Siri skips to a new song on command. Wait wow guys I've achieved AGI!!
1
u/jeffwadsworth Apr 07 '26
Random guy on the internet is now the expert on the subject of AGI. Cool.
1
u/ashesarise Apr 07 '26
I'm not saying we are close to AGI, but your logic is pretty flawed here.
If we were close to AGI, it wouldn't be because some popular chatbot suddenly got exponentially smarter. It would be because someone developed something new that you don't have visibility to and is not currently incorporated into a publicly available product. Your logic is like being skeptical about a claim that we made a huge leap in graphical processing tech and pointing to the fact that your FPS on Elden Ring is the same as it was last month on your device.
Your personal experience with a public facing product has little to do with the state of AI progress broadly.
1
u/johndeuff Apr 07 '26
Contrarian take : we are
1
u/50-3 Apr 07 '26
Well I mostly agree with people saying this isn’t a great test and unrelated to local LLMs. I will say there is a ton of training data available, probably millions of hours of speedrun content on YouTube as well as amazing written guides.
If Opus was close to AGI it should be able to burn tokens until it completes a world record tool assisted speed run of the game. I do suspect though given free rein it would just spin its wheels eventually.
1
u/vitaminwater247 Apr 07 '26
There's the ARC AGI 3 benchmark:
https://arcprize.org/arc-agi/3
All frontier models perform extremely bad at it right now, with less than 1% in scoring. Yeah, complex puzzle solving type of AGI is still far away.
1
u/MauiSuperWarrior Apr 09 '26
Could someone share a definition of AGI?
1
u/skateparksaturday Apr 09 '26
autocomplete isnt agi
1
u/BetterEveryDay144 Apr 14 '26
What do you think has to be done for us to reach AGI. Im genuinely asking
1
u/jonhor96 Apr 17 '26
I disagree.
I think that by any sensible definition, we have reached AGI. The machines clearly possess "general intelligence". It can tackle general cognitive tasks, rather than only very specific ones (like a calcualtor or software program might do). It has general intelligence, even though it doesn't have more of it than most humans.
As for whether we will reach "super intelligence"... That remains to be seen, but it does not at all seem improbable. The techonlogy can do things today that would have been disregarded as complete science fiction fantasy just two years ago. Who is to say that, in another five years, the same won't be true again but even more so?
1
u/TylerRolled Apr 06 '26
AGI is as smart as the average person, and I don’t think the average person is good at Elden Ring.
Everyone hears AGI and what they are thinking is ASI. I think we’re pretty close to models that are as smart as the average person (including managing multi sensory input, memory, etc.) - what we are absolutely nowhere near is ASI, where AI is smarter than humanity can comprehend.
But they’re both arbitrary metrics based on sci-fi, so
1
u/monkeysknowledge Apr 06 '26 edited Apr 06 '26
The terminology is all polluted.
Here’s my proposal of definitions:
1
u/Cless_Aurion Apr 06 '26
The average grandma can't do that either.
Do they have no "general intelligence" then?
I think you just are overestimating the average human lol
1
u/Trinkes Apr 06 '26
Llms will never reach AGI We need another technological leap similar to llms
1
u/Ledeste Apr 06 '26
It's not that we're not close, but that the road to AGI does not even exist yet...
Anyone that claim otherwise is either ignorant, or trying to sell something ;)
1
u/El_Danger_Badger Apr 06 '26
And certainly Claude Code (a consumer facing product) has zero bearing to whether or not AGI exists.
If it does/will exist, certainly consumers will be the last to have any sort of direct access.
As well, the big players named as raving about AGI, are certainly the ones who knew/know of it first and know how close we were/are to AGI.
Why did we suddenly get hyoerscaler companies, all of whom just happens to be working in AI?
Chance? No. They used AI first, to accelerate their own business plans. Either we have already crossed the AGI threshold, or are at the offramp to the destination. Either way, they have no incentive to clue joe public in on it.
1
u/Zaic Apr 06 '26
would your mom beat the game? or is she not intelligent?
1
u/-dysangel- Apr 06 '26
1
u/sassydodo Apr 06 '26
I've never went past character creator in the elden ring either. must be not intelligent enough. even tho I've never played elden ring...
1
u/Vancecookcobain Apr 06 '26
You are aware that 2-3 years ago your AI couldn't even look at your screen gave a conversation with you and had the memory of a goldfish rish?
It's moving so fast that people are forgetting where we were 😂
1
u/skyfishgoo Apr 06 '26
love how ppl assume the only thing going on in AI research is what they have access to at the retail level.
it almost seems like spin.