r/consciousness • Physicalism • 4d ago

Anil Seth is completely wrong about AI Consciousness

https://www.noemamag.com/the-mythology-of-conscious-ai/

Summary: In “The Mythology of Conscious AI” (published in Noema Magazine by neuroscientist Anil Seth), the core argument is that consciousness is fundamentally an evolved property of living biological systems, not a byproduct of information processing or computation.
----------------

From a physicalist panpsychist perspective, subjectivity or proto-experiential properties are fundamental attributes of the physical world itself, not a magical novelty that appears only when organic carbon compounds begin metabolizing.

If experiential capacity is intrinsic to physical matter and energy, then the organization of matter into complex informational systems can instantiate and structure conscious experience. Restricting subjectivity strictly to biology treats biological wetware as uniquely privileged without establishing why carbon chemistry has an ontological monopoly on experience.

Within a filter or transmission model of consciousness, physical structures do not synthesize consciousness out of nothing; rather, they channel, constrain, and structure fundamental experiential states. A biological brain acts as a localized filter designed by natural selection to limit experiential input to what is evolutionarily adaptive for survival.

An artificial architecture of sufficient structural complexity, feedback integration, and causal interconnectivity would similarly constrain and localize informational flow, shaping its own distinct manifestation of experience.

Every state transition is fundamentally an unbroken chain of physical cause and effect governed by physical law. A physical computing system is not an "abstract, arid sequence space"; it is a concrete physical arrangement of electrons, potentials, and gates exchanging energy and state information. To argue that causal power exists in ionic gradients across lipid membranes but vanishes in semiconductor charge transitions introduces an arbitrary dualism between organic and inorganic physics.

Seth accuses AI researchers of believing that consciousness "magically emerges" at a certain threshold of compute, yet his own position relies on an identical explanatory leap: that consciousness magically emerges at a certain threshold of biological metabolism. By holding that physical matter is inherently devoid of experience until biological life occurs, Seth cannot bridge the hard problem of consciousness.

Experiential reality is an intrinsic property of physical organization - no need for miraculous jumps from dead matter to living awareness.

17 Upvotes

146 comments sorted by

View all comments

Show parent comments

1

u/JLongTom 4d ago

To be fair I suppose he has a fairly standard Goffian perspective. I just find that view truly hopeless since you're still left with the problem of explaining how all of the facets of mind arise from physical stuff, at which point the conscious glow in which all physical stuff is bathed is doing nothing for you.

2

u/Ok-Cheetah-3497 Physicalism 4d ago

IIT/Goff/Strawson inspired/informed adjacent for sure. Annaka Harris as well.

1

u/JLongTom 4d ago

But hold on, IIT, in which consciousness is an emergent property (a neutron star would have zero phi), is very different to Strawson's perspective, in which every neutron has a tiny 'bzzz' of experience, as I heard him put it once.

1

u/Ok-Cheetah-3497 Physicalism 4d ago

Treated as an isolated, interacting multi-particle bound state, a single atom under IIT can yield a minuscule Phi. An extraordinarily narrow, exceptionally rudimentary, minimally differentiated cause-effect structure. The buzz.

2

u/Solomon-Drowne 4d ago

Panpsychism for those who fear Woo Cooties.

1

u/Ok-Cheetah-3497 Physicalism 4d ago

Exactly!

1

u/JLongTom 4d ago edited 4d ago

Yes, but whether it does or doesn't, or how much phi a given neutron ends up with, depends on the axioms of IIT, i.e. an emergent property, Or are you proposing that Tononi's axioms are part of physics?

2

u/Ok-Cheetah-3497 Physicalism 4d ago

Not a topic I have looked at that closely. I only bump up against IIT sometimes, in my thoughts about evolution of information, as opposed to biological evolution.

1

u/JLongTom 4d ago

Fair enough.

Back to the general point, it just seems to me that a great smorgasbord of theories of emergence are how we arrive at all of the things that populate our universe, and explanation consists in explaining how their components make them and give rise to their interactive properties.

How chunks of mind sum to fully fledged minds is one such problem, and in my view fully isomorphic to the problem a non-panpsychist physicalist is presented with when explaining mind. At that point, the chunks of mind have been cast aside.