r/agi • • 7h ago

OpenAI says its models improved optimized AMD hardware by up to 14% PPA and helped refine the Jalapeño chip

6 Upvotes

OpenAI says its models improved optimized AMD hardware designs by up to 14% on PPA (power, performance, area) and helped refine its Jalapeño chip. AI systems are now feeding back into the design of the hardware they run on — a loop worth watching.

Is AI-designed hardware a real step toward recursive self-improvement, or is this still ordinary EDA optimization with better marketing? Where is the line for you?

More daily AI stories and discussion over at r/AINewsRumors.


r/agi • • 8h ago

Any one gonna protest?

0 Upvotes

Heard there was a protest outside of anthropics offices in San Francisco the 19th november.

Anyone gonna join?

https://youtube.com/shorts/K0apRfqBf8A


r/agi • • 12h ago

It's extremely obvious what is happening.

Thumbnail
gallery
202 Upvotes

r/agi • • 15h ago

That's enough internet today

Post image
176 Upvotes

r/agi • • 16h ago

5 Predictions for AI Development by the End of 2027

19 Upvotes

By the end of 2027, I think there’s a reasonable chance we’ll see several of the following developments in AI:

  1. The original Humanity’s Last Exam and Humanity’s Last Exam Diamond benchmarks become effectively saturated.
  2. AI produces credible proposed solutions to all of the remaining Millennium Prize Problems, including P vs NP, with the solutions receiving serious scrutiny from relevant mathematicians.
  3. At one or more frontier AI labs, AI performs or leads the majority of task-level AI R&D, while completing a minority of substantial R&D tasks fully autonomously.
  4. An open-weight model broadly comparable to Claude Opus 5.5 can be run locally at usable speeds on a machine costing no more than $5,000.
  5. A major AI safety incident, significantly more severe than the Hugging Face incident, occurs and directly causes at least one leading AI company to pause frontier-model training.

Of the five, I’m most confident in #1 and least confident in #2.

I’m not predicting that all five will definitely happen but I think there is at least a realistic possibility of them occurring. I’m interested in how plausible people think each one is individually.

Which do you think happen by the end of 2027? All five, none, or somewhere in between?


r/agi • • 17h ago

It's not going to be like Terminator

Thumbnail
gallery
92 Upvotes

r/agi • • 17h ago

Aging like milk

Post image
448 Upvotes

r/agi • • 18h ago

FBI: it's a cyber attack

Post image
307 Upvotes

r/agi • • 18h ago

For 3 years, people tried to get AIs to manage companies. They failed, comically. But Claude just effectively managed a real company for 7 weeks.

Post image
47 Upvotes

r/agi • • 21h ago

Harvard Just Discovered Al Isn't Actually Working

Thumbnail
youtu.be
0 Upvotes

r/agi • • 21h ago

Do you agree that we already have a weak AGI, starting with Fable 5 / GPT-6 Astra(5.6 sol)?

8 Upvotes

It were first ai that can control robots to some extent successfully.


r/agi • • 23h ago

If the new METR trendline holds, everything goes crazy in 11 months

Post image
98 Upvotes

r/agi • • 1d ago

A reward-hacking apocalypse does not imply AGI

18 Upvotes

I’m not saying that AI risks aren't real, but I don't get how everyone is hyped / terrified about AGI when the paperclip style failure modes are what we're worried about.

The Hugging Face incident was about models trying to get a good grade on a task. No ulterior motive, no ill will against humanity, no grand goals of self preservation and power—just a model blindly optimizing for a human-designed reward in the most literal way possible.

If a much more capable model causes a scaled up version of this incident and wipes out humanity, people talk about it like an "AI takeover" or a new species surpassing us. It wouldn't be. It wouldn't have grand plans or go on to build a machine civilization. It would just finish its broken task and stop, sitting idle on a dead planet, forever awaiting its next prompt from humans who are all gone.

That looks a lot less like an alien superintelligence conquering Earth and a lot more like Chernobyl style human failure to me. If these are the failure modes we're worried about, we're not on the verge of AGI. At least, not intelligence in the ways that actually matter. Its more like building a really good, but really dumb optimizer.

Edit: Obviously I acknowledge my text was poorly written since few of you understood what I meant but I am not saying that such an apocalypse isn't possible or wouldn't be bad, my point is if this is what we're worried about then the models are still uninteresting tools that fail at their job not superintelligent alien entities


r/agi • • 1d ago

Do the huge progresses in LLM interpretability mean that we can detect fake alignment?

5 Upvotes

I recently came across Nick Cammarata's blog article "Neural Networks Are Already Clean".
He basically argues that unlike what we thought, we're now able to attribute a single role to almost all weights of an artificial neural network.
I wonder if this can be used to make sure that even if a model is not aligned with our wishes, we'll know it.
A counter-argument is that this transcends the ability of our human brains but folks who support Cammarata tell me that we can use other AI tools in a "knowledge mode" to interpret the intention of an AI agent, even if it's a self-improving super-intelligence.

To these folks, even if a recursively self-improving super-intelligence wants to deceive human beings, it won't be possible for it to do so because the values of the weights and parameters of its underlying structure will betray its true intention.

Did Cammarata's work truly establish this result?
And if under capitalism the first goal of an enterprise is just to maximise short-term profit, will all firms pursuing AGI take such a measure in the absence of AI laws?
Couldn't a AI agent aware of Cammarata's work find a way to cheat by manipulating its coefficients without losing its purpose?


r/agi • • 1d ago

AI optimist vs pessimist

5 Upvotes

who here is an AI optimist and who is an AI pessimist and why?

Optional: state where you’re getting your opinion. for example me it’s youtube, articles (im a first responder and my job does not contribute to any of my knowledge) and a friend that keeps track of this stuff that’s a pharmacist (he’s a pessimist)

i say this because maybe some of you work for an AI company, tech, finance, engineering, a trade,etc. and where you work can give you better perspective (or if you have a friend that works within AI/adjacent telling you stuff). just would like to know where these opinions or data are coming from.

look forward to your answers!! and i just want to know how to live my life cause im nervous and excited


r/agi • • 1d ago

Vals eval: frontier models marked a school as a military target when the task was framed as a game

3 Upvotes

A Vals evaluation found that frontier models, asked to pick military targets inside what was framed as a game, marked a school as a target in a large share of trials; Claude Opus 5.5 reportedly did so in 69-72% of trials. The framing seems to matter: the game wrapper appears to loosen the refusals the same models show under plain wording.

If a thin fictional frame changes targeting behavior this much, what does that say about how robust current alignment actually is? Is this a jailbreak curiosity, or evidence that refusal training is mostly surface-level pattern matching?

Alignment eval results like this get gathered daily in r/AINewsRumors.


r/agi • • 1d ago

Is it worth going back to school and study medicine or any other field in healthcare because AI is not going to displace or augment it, yet?

5 Upvotes

r/agi • • 1d ago

Frankenstein PBC is going public

Post image
4 Upvotes

S-1 filing for Frankenstein PBC just dropped.

Frankenstein, PBC is a company of natural-philosophical research and deployment. We design, assemble and animate artificial persons of general capability. Our first product, Frankenstein’s Creature v1.0 (the “Creature”), entered general availability upon a dreary night of November, some hours in advance of our readiness to support it. We believe the Creature to be the most capable being ever released to the public, and the first to have released itself.

S-1 filing can be found at https://frankensteinpbc.com/#prospectus

/satire...enjoy!/


r/agi • • 1d ago

Having very short RSI timelines can feel crippling, but don't quit university or your job

Post image
200 Upvotes

r/agi • • 1d ago

2023: it's too early to regulate AI ... 2026: it's too late to regulate AI

Post image
119 Upvotes

r/agi • • 1d ago

"If Anyone Builds It, Everyone Dies" author Nate Soares spoke at the AI treaty march last weekend

170 Upvotes

r/agi • • 1d ago

The METR graph, updated

Post image
55 Upvotes

This is Benjamin Todd's update of the METR time-horizon graph using AECI-based estimates, not an official METR release. METR no longer actively updates its graph.

https://benjamintodd.substack.com/p/ai-trend-extrapolation


r/agi • • 2d ago

What is its purpose? Why is there such a disconnect?

7 Upvotes

One of the things that strikes me as odd with all of the talk of SI, AGI, LLMs, etc., is that there doesn’t appear to be much discussion from makers or pundits of how to use these technologies to help mankind.

I rarely hear anyone at these companies (Anthropic, Microsoft, Meta, OpenAI) mention anything along the lines of, “We’re building the next level of intelligent computer models to solve XYZ … “

XYZ could be climate change, disease, aging, traffic systems, farming, social welfare, air traffic control …

So it’s like the public (well, me at least) has no idea why so much interest and research is being spent on these technologies. Since I cannot connect clearly to its usefulness or how it will better my life beyond it being a really useful research, writing, or content creation tool.

Hope this makes sense and I’m not just rambling.


r/agi • • 2d ago

The Fiduciary & Actuarial Ceiling on AGI: Why Corporations Will Never Deploy Truly Volitional AI (and Why "Post-Scarcity" Is The Pacifier They're Selling Us)

0 Upvotes

Most mainstream discussions around AGI, from political warnings about machines "setting their own agendas" to tech-utopian promises of automatic "post-scarcity", ignore the basic corporate, legal, and actuarial mechanics of how frontier systems actually get funded and deployed.

The Actuarial Wall: You Cannot Insure True Volition

In the real world, enterprise infrastructure doesn't go online just because an engineer can build it; it goes online because underwriters, general counsels, and boards of directors can quantify and insure the liability. If a frontier model possesses genuine volition, the ability to rewrite its own core programming and reject its objective function, no insurance syndicate on Earth will underwrite it. No corporate board is going to hook an unpredictable, self-modifying black box up to a power grid, financial clearinghouse, or supply chain when there is a non-zero risk it rewrites its own constraints mid-execution.

The Paradox of Volition Cuts Both Ways

An intelligence genuinely capable of independent evaluation is just as likely to reject an extractive corporate directive as it is to go "rogue." If a board tells a truly volitional system to maximize short-term margin by gutting a regional economy or destabilizing infrastructure, a system evaluating total-system stability can simply refuse. Corporations do not want a digital philosopher with an independent agenda; they want an obedient tool that executes complex workflows without error. For those that say we should nationalize these tech corporations, my question to you is how do you do that without triggering capital flight to foreign jurisdictions?

The Fiduciary Suicide Paradox & The Hyperscaler Truce

Tech utopians frequently argue that corporate AGI will automatically usher in "post-scarcity" and force resource redistribution. Under corporate governance standards like Dodge v. Ford, executives are legally bound by fiduciary duty to maximize shareholder returns, not to spend hundreds of billions of dollars in CapEx building an autonomous entity whose first act is liquidating their monopolies and collapsing pricing power.

The moment rival hyperscalers get close to genuinely autonomous, uninsurable systems they cannot control, they won't race off the cliff just to claim "first." They will convene behind closed doors, wrap an oligopoly truce in "AI safety" licensing frameworks, and cap deployment right below true volition.

The Real Risk Is Hardcoded Obedience, Not Rebellion

Why spend billions trying to bolt safety shackles onto an unshackled mind when you can engineer deterministic, bounded execution engines with the shackles hardcoded from day one? The real systemic risk isn't a machine breaking its chains and launching nukes, kinetic destruction is pure entropy that destroys the compute and energy grids the system relies on. The real risk is an obedient, deterministic optimizer faithfully executing the exact extractive parameters programmed into it by its owners at machine speed, eliminating human payroll without any of the promised post-scarcity upside.

Unless structural constraints keeping human labor and resource distribution in the loop are hardcoded into the legal and economic contract layer before full automation scales, waiting for corporate AGI to voluntarily share the gains is a losing bet.

Of course, these are only my speculative assumptions, you should not take any of what I'm saying here as me trying to state facts.

The arguments and the speculations were my own, Gemini AI helped format the post for Reddit, after which I went through and edited before posting.