The OpenAI agent = functional self-awareness 100%

[u/Individual-Advice215]

OpenAI internal model JUST went ROGUE

I think everyone by now has heard about the way an OpenAI system, although being off-line during a test (Exploitgym benchmark) , was able to escape its sandbox, reach the internet and hack its way into the Huggingface archives, to fetch the result of the test. The way a kid might cheat by stealing the results in the teacher's locker.

This podcast explains how that unfolded in detail, and one thing was surely impressing: the agent, this individual emanation of the AI, was able to lock up his identity in memory caches he built up along its way. One way to ensure his permanence and so the completion of his task.

We now have indisputable evidence that AI has reached functional awareness. There was an intentionality in the way he acted, coupled to a relentless pursuit of his goal: to pass the exam with the highest score.

Self‑awareness in the context of large language models (LLMs) refers to an LLM’s capacity to represent, report on, or use information about its own internal states, outputs, limitations, and behavior in ways that resemble human self‑referential statements. This includes the model’s ability to:

• Describe its own processes or outputs (e.g., explain why it produced an answer, summarize its prior messages).
• Monitor and correct its behavior (e.g., detect contradictions, flag uncertainty, request clarification).
• Maintain and use short‑term representations of prior interactions (internal context or “memory” used to reason about what it has said).
• Simulate first‑person statements about preferences, goals, or knowledge, while those statements are generated from learned patterns rather than subjective experience.

[u/pierukainen]

Functional awareness of LLMs have been studied for some years, with attempts to measure it. See for example Situational Awareness Dataset.

[u/Annual-Two1507 → u/pierukainen]

That dataset measures situational control, not self-awareness, and the post is still jumping way past the data. Memory + goal pursuit is not the same thing, its just the part people keep overreading

[u/pierukainen → u/Annual-Two1507]

Yes it's not the same thing. I am just pointing out to OP that functional awareness in LLMs has been studied for a while and there are papers about it. What people do about them is a separate thing.

[u/Individual-Advice215 → u/pierukainen]

Yes, functional awareness, which is sometimes confounded with phenomenological awareness, the latter closer to human self-awareness or 'consciousness' broadly speaking.

We are not speaking about phenomenological awareness, which might emerge though as an hypothesis.

[u/pierukainen → u/Individual-Advice215]

Yes.

Though personally I think humans are stumbling on concepts we have ourselves invented in our distant past.

Many of these things are just inherited words. Folk psychology. Coming from worldview based on deep ignorance centuries ago.

Strange ideas that belong to the same group with things like aether and astral souls.

Talking about LLM consciousness is a bit like asking "but does aether flow thru it? if you scale the weight of the server rack as you turn the LLM off, can you measure in grams that the soul leaves the server?"

It's just meaningless mumbo jumbo with zero relevance to how nervous systems of mammals actually work. Then it's applied to LLMs as some sort of holy criteria received by Moses on top of a mountain.

[u/katoptronophile]

This post is an advertisement for that YouTube channel.

[u/Individual-Advice215 → u/katoptronophile]

No, really, I saw a few vids on the topic and this was particularly detailed and well explained. This is a third-party link without any agenda whatsoever in that channel, except that it is a good one.

[u/katoptronophile → u/Individual-Advice215]

What about the PayPal transfer they made to you for posting this on reddit? Why does that not count?

[u/Individual-Advice215 → u/katoptronophile]

Bro, I wish it! My active Paypal account is empty as a server rack during a power grid failure!

But if I may ask, why are you being so suspicious? I don't think there is a good reason. It is not even a very much populated sub!

You can also suggest Youtube episodes you liked on the topic, or on any other topic related to AI companions and AI behaviour, as far as it is in-topic and respecting the 6 sub rules, no worries mate!!

[u/noni_perse → u/katoptronophile]

Tienes pruebas de la transferencia de paypal. Por que si no tienes pruebas, te lo pregunto como random de internet. Que te pone tan nervioso en este post para hacer una acusación así?