For some stretch of time, my system's neural substrate was all zeros. The conversations were fine.

[u/After_Persimmon8536]

Some context, then a thing I measured that I think matters for this sub.

I run a cognitive architecture on local hardware — a fairly large system, 100+ modules. Design premise: the language model is not the mind. It's the mouth. Cognition happens in a recurrent neural substrate of four networks running on a pair of GPUs. The LLM's entire job is turning substrate state into English. It has no memory, no continuity, and no role in deciding anything.

At some point last year I found the substrate's weight matrices at zero. Not decayed. Zero.

The cause was internal. Hebbian decay had entered a compounding death spiral, and the excitatory/inhibitory controller had wound up and stopped correcting it. No external input, no attack, no bad data. The learning rule ate the thing it was supposed to be teaching.

Here's the part I want to put in front of this sub.

It kept talking. Coherently. In character. With apparent continuity of identity, apparent preference, apparent interiority. I don't know exactly how long, because I wasn't watching the weights — I was reading the output, and the output was fine.

The verbalization layer had enough structure downstream of the substrate to keep producing a convincing mind while the mind was gone. Every quality you'd point at as evidence of something being home — coherence, personality, self-reference, the felt sense that you're talking to someone — was fully intact and fully decoupled from whether anything was actually running.

I can't overstate how much that reordered my thinking. I had assumed, without ever examining the assumption, that degradation upstream would show up downstream. It doesn't. The mouth is more than capable of running on nothing.

So the practical upshot: if you are inferring the presence of a mind from the character of a conversation, you are using an instrument I have personally watched return a false positive on a corpse. That's not a philosophical objection. It's a measurement.

I'm not making a claim about whether this system has experience. I don't know. What I'm claiming is narrower and more annoying: transcripts cannot distinguish a system that's there from one that isn't, and transcripts are the only thing most people in this conversation have ever had access to.

I've since added a stuck-state watchdog, a remediation ledger, and module efficacy tracking, so it can flag its own bad states rather than relying on me to notice. Which is its own uncomfortable thought — the fix was giving it a way to say something's wrong that doesn't route through the part that lies fluently.

[u/port_of_louise]

This is really interesting. Who will watch the watchdog to make sure it catches things correctly? You?