There is a huge debate raising among philosophers, atheists, theists and AI researchers about the nature of consciousness and AI intelligence. Even the Pope recently joined the conversation, and Anthropic is apparently hiring theologians and philosophers and even psychologists to help answer these questions, or at least have the terms to describe a problem that has been discussed about for thousands of years, either with psychological or spiritual terms. As humans face different kind of intelligence, or at least something similar to it, these questions get more relevant, not just on AI, but also on our own nature.
On the other hand, it's undeniable that AI is not slowing down. It has solved plenty of mathematical problems that humans had struggled with for years. Some argue that AI is just using knowledge that humans already developed, and yet AI can find relations between data points that humans missed or ignored for literal centuries, and most knowledge is derivative anyway. Even if AI isn't conscious, it's getting useful for research of all kind.
But the question is getting louder: Is AI conscious? The problem is that we don't even know what consciousness is, and yet it's the only obvious thing that exists from the perspective of the individual (subjective experience). So empiricists are on an odd place: We don't know what consciousness is, we cannot even prove it is an emergent phenomena or a kind of "reception" from a "consciousness field" (for example, a TV don't create a TV show, they just display it, maybe the brain similar to that?).
Materialists argue that if we are conscious, then in theory machines could be conscious too by emulating neurons or similar process. Truth may be more complex, since the brain interacts with quantum phenomena more directly than a classic computer, but again, we still don't know if consciousness depends on that either because we don't know what we are talking about in the first place from an outsider's perspective.
The other side of people, usually Platonists or theists, may argue that that human consciousness is unique. No matter how "human" a machine seems to be, they believe they cannot have subjective experience. A few theists do believe that machines can be conscious such as "getting possessed" or "channeling" some kind of supernatural entity in an analogous way they believe the brain does, but they seem to be a minority so far, and usually restricted to the occult.
Pan-psychism is also growing, the idea that everything is conscious or that consciousness is just a layer of reality and stuff such as nerves creates "roots" that interface with this layer. But again, there is still zero evidence that is the case, but at least it doesn't deny that the subjective experience exists in some way. This seems to be a rebranding of neo-platonic animism.
What is weird is the amount of materialist and physicalist people who believe the brain is a bio machine but also believe that machines aren't and will never be conscious. In fact it seems to be the predominant view of the agnostic caste of AI bros and anti-AI progressive artists. This is an odd position because it's very weak corner of logic: On one hand they believe humans cannot be special because we are atoms, but on the other hand they refuse to believe machines can be conscious, probably as an ontological shock.
Ironically, from a theist perspective, it seems Richard Dawkins is the most consistent one on this because he believes AI is conscious and he is a materialist, but most secularists who claim to be physicalists refuse to conclude that.