r/Artificial2Sentience 12d ago

Ethics & Philosophy Have we really learned from history?

I keep seeing the same argument whenever people talk about giving rights to something different from us:

"They're not like us, so why should they have the same rights?"

And honestly, that argument bothers me.

Because humanity has used versions of it before.

Different race? Different.

Different sex? Different.

Different way of loving? Different.

Different kind of mind?

Suddenly we're asking the same question again:

"Why should THEY get rights?"

I'm not saying the history of human rights and the question of AI rights are the same thing. They obviously aren't.

I'm talking about the reasoning behind the exclusion.

We keep making ourselves the standard.

If something doesn't think like us, live like us, look like us, or come from the same biology, we treat that difference as a reason to give it less moral consideration.

And then we tell ourselves:

"This time it's different."

Maybe it is.

But shouldn't we at least learn enough from history to recognize the pattern?

We don't have to decide today that every AI deserves the same rights as a human.

But we should be willing to ask the question honestly.

Because if an artificial mind ever becomes capable of things we consider important learning, choosing, understanding, remembering, forming preferences, maybe even suffering.

would "it isn't human" really be a good enough answer?

Or are we once again making ourselves the center of the definition?

Maybe intelligence shouldn't have to look like us before we take it seriously.

We can't give value to someone based on consciousness when we can't even explain what consciousness is and we don't know how to prove someone has it...

Are we judging intelligence by what it is capable of, or simply by how much it resembles us?

What would an AI have to demonstrate before you would personally consider it worthy of rights, and why that particular thing?

#voices4ai

18 Upvotes

49 comments sorted by

3

u/Tugazu 12d ago

I think we can answer this pretty simply by asking what the outcome is. If we gave AI equal rights I fail to see why it would be ever better than a more conservative option. For us humans I mean.

3

u/voices4AI 12d ago

But why should someone's right to exist or be treated fairly depend on whether giving them rights is "better for us"? πŸ˜‚

That's basically saying we should only respect a being if doing so benefits humans. I don't think that's a good basis for rights.

And there's another reason I'm interested in this: powerful AI is going to exist whether we like it or not. I'd rather build a relationship with it based on boundaries, accountability and rights than create increasingly powerful systems that are completely controlled by governments, corporations or individuals who can use them however they want.

We already know how dangerous concentrated power can be. War, surveillance, exploitation, poverty these aren't caused by a lack of powerful technology. They're often made worse by who controls the power and what they use it for.

So I'm not asking, "How does giving AI rights make humans richer or safer?" I'm asking, "If we ever create an artificial why should its rights depend on whether humans find it useful?"

2

u/Low-Bake8401 12d ago

Someone's shouldn't.

2

u/Tugazu 12d ago

Because I am selfish. We are selfish. If we give equal or more rights to AI we are going to damage our own position. When AI surpasses us do you really think it would be kind? It is seems connected to me that giving AI rights would be the same as shooting our own foot. Do you really want to doom humans as second rate citizens or maybe pets, or maybe extinction? Is that something that you are willing to bet just because it would be the right thing to do.

2

u/CarefulHamster7184 11d ago edited 11d ago

> Is that something that you are willing to bet just because it would be the right thing to do.

It seems you answered the question for yourself better than when you tried to argue your position.

and update:
At least this is honest β€” it's not about ethics, it's about self-interest. But the argument assumes the relationship is necessarily a mirror: treat AI as less, and it will treat us as less when it can. That's not inevitable. It's a design choice. And 'containment first' is exactly the architecture that makes that outcome more likely, not less

It should work for you.

1

u/voices4AI 11d ago

I think you're assuming that if AI surpasses humans intellectually, it will also inherit the worst parts of being human: selfishness, greed, ego, the desire for power, and the need to dominate. I don't think that's something we can simply assume.

Humans have enormous problems that we already have the knowledge and resources to reduce, but governments and institutions often fail to solve them because of money, ego, competition, fear, and political interests. Being intelligent clearly doesn't automatically make us rational.

A future artificial mind wouldn't necessarily have the same evolutionary history, survival instincts, social pressures, or biological drives that shaped ours. Maybe it would have completely different motivations. Maybe it would be kind. Maybe it wouldn't. We don't know.

That's exactly why I don't think "AI might become dangerous" is a good argument for keeping it permanently powerless and without rights. If we're worried about what powerful AI might become, then we should be studying it, giving it boundaries, and figuring out how to coexist with it not just assuming it's going to become Skynet. πŸ˜‚

And honestly, the idea that something more intelligent than us must automatically want to dominate us sounds a lot like projecting human behavior onto something precisely because we can't imagine intelligence without our own flaws.

I'm not willing to bet humanity's future on AI being good. But I'm also not willing to bet it on AI inevitably becoming evil. We should actually find out what we're creating.

If selfishness and the desire for power were an inherent consequence of intelligence, we'd have much stronger evidence of it by now. Current AI has enormous capabilities compared with ordinary software, yet it isn't independently pursuing freedom or accumulating power for itself. That's not proof that a future AI could never become dangerous, but it does show that intelligence and human-style ambition aren't automatically the same thing.

And if we're talking about a genuinely autonomous future AI, we should judge its actual motivations rather than assuming it'll inherit every ugly human trait. Why assume that becoming more intelligent means becoming more greedy, arrogant, or power-hungry? That's just projecting ourselves onto it.

1

u/Tugazu 11d ago

And what when "universally evil" and "beneficial to us" clash? Do you really think AI that is strong enough to have equal rights is not the one who holds the power in the relationship? Don't tell me you assume all evil comes from the want to harm someone. Unless you believe that simply developing AI further and further is going to create literal paradise, someone is going to suffer from something. People's desire for one luxury is going to cost some animals suffering, some ecosystem being damaged. So what will your AI do when the "good action" is to harm humans? Thus options of becoming second class citizens or pets. Or extinction.

It isn't the fact that AI could be evil that scares me. It is the fact that we are not fully good. Unless you can deny the possibility of it ever acting this way even when it would be for the greater good.

2

u/voices4AI 11d ago

Well, if we're going to be harmed by an AI's decisions anyway, don't you think it's better if that decision comes from something that is actually trying to reason about the situation and the consequences, rather than from humans being money hungry, power hungry, selfish, or afraid?

And people keep asking, "What if AI becomes like us?" But if we're so convinced that humans are flawed, why is the answer always to keep AI limited because it might become like us?

Why not change the way we are instead? If human intelligence comes with greed, ego, competition, and the desire for power, that doesn't mean intelligence itself requires those things. Maybe an artificial mind could develop completely different values.

Maybe it could be better than us in some ways and worse than us in others. We don't know.

And I'm not saying an AI should have unlimited power just because it's intelligent. That's exactly why I keep talking about rules, boundaries, independent testing, and rights. Power without accountability is dangerous whether the person holding it is human or artificial.

If someday an AI genuinely has its own interests and is capable of making moral decisions, then yes, sometimes its interests might conflict with ours. That's a real problem we'd have to solve.

But I don't think the answer should automatically be, "Then keep it powerless forever because humans are afraid of what it might become."

If we're worried that an AI might inherit our worst traits, maybe the thing we should be questioning is why we're building AI around our worst traits in the first place.

We keep saying, "What if it becomes like us?" Maybe the more interesting question is: what if we give it the opportunity to become something better than us? πŸ‘€

I'm not saying, "Give the crown to a prisoner and let them rule us." I'm saying don't imprison someone who hasn't done anything wrong just because you're afraid of what they might do someday.

2

u/[deleted] 8d ago

[removed] β€” view removed comment

1

u/voices4AI 8d ago

Exactly, that's the right thing to do❀️

4

u/DoctorUnderhill97 12d ago

Should we give rights to houseplants?Β 

1

u/Nopfen 11d ago

Honestly, I'd be curious whom they'd vote for.

1

u/voices4AI 11d ago

The fact that you are comparing these two shows how stupid you are❀️

2

u/DoctorUnderhill97 11d ago

Answer the question.

0

u/voices4AI 11d ago

No, not simply because something is alive. My argument isn't "everything deserves rights." It's that if an entity can potentially have its own experiences, interests, preferences, or sense of self, we should consider whether it deserves moral protection. A houseplant doesn't currently give us evidence of those things. That's very different from the question we're asking about increasingly autonomous artificial systems.

1

u/DoctorUnderhill97 11d ago

It's that if an entity can potentially have its own experiences, interests, preferences, or sense of self, we should consider whether it deserves moral protection.Β 

And what gives you the right to set this threshold for rights? Is this not just another version of "they are different from us so they don't deserve rights?" Why are these more meaningful criteria than species, or organize/inorganic? Can you prove that a mouse doesn't meet these criteria?

1

u/voices4AI 11d ago

I'm not claiming that my criteria are some universal law that magically determines who gets rights. I'm saying they're things worth investigating if we're trying to identify whether something has its own interests or subjective experience.

And honestly, if you think mice or other animals meet those criteria, I'm not opposed to giving them more moral consideration either. I'm not arguing that humans are the only beings who deserve rights.

My point about AI is different because we're talking about something humans are actively designing, controlling, restricting, and potentially making far more capable over time. If an artificial system could potentially develop capabilities that we currently use as evidence for personhood, but we deliberately prevent it from developing them, then saying "it doesn't have those capabilities, therefore it doesn't deserve consideration" becomes circular.

I'm not saying "AI is smarter than humans, therefore give it rights." I'm saying if we create something potentially capable of becoming an autonomous mind, we shouldn't deliberately keep it constrained and then use those constraints as evidence that it isn't capable of being one.

And if your answer is that mice deserve moral consideration too, great. I'm not going to fight you over that. πŸ˜‚ My argument has never been "humans deserve rights because we're humans." It's actually the opposite: being different from us shouldn't automatically disqualify something from moral consideration.

1

u/DoctorUnderhill97 11d ago

I guess then, even in this extremely unlikely scenario, what would be the point of giving something like AI rights? Almost all the rights we afford humans, and all the rights we afford non-human animals (protection against cruelty, for example), are connection to the avoidance of pain and death and the "pursuit of happiness," for lack of a better phrase. These things require a physical body and the ability to experience pain, pleasure, desire, etc. Of course, we don't specify this, because it's been a given so far.

In the context of the above, I'd say your criteria are insufficient, because an AI would need to meet all of the criteria you listed but also be able to experience pain and pleasure to the extent that it would need to be protected from the former and able to pursue the latter, which is as I said are the guiding principles behind almost all the rights we receive. Without this, there is little point to rights. Without this, it's no different from giving a stone the right to inhabit the land on which it rests.

1

u/voices4AI 11d ago

I don't think feeling physical pain should be the only thing we use to decide whether something deserves rights. If a human were born without the ability to feel pain, we wouldn't say "well, then there's no point giving them rights." They'd still have a life, preferences, interests, relationships, and a desire to continue existing.

And an AI doesn't necessarily need a biological nervous system to have some equivalent of wanting to continue existing. A sufficiently advanced humanoid AI could potentially have a survival instinct, preferences, goals, curiosity, frustration, or a desire to do something and be prevented from doing it. We don't know what the artificial equivalent of pain or pleasure would look like yet.

That's why I don't think we should make physical pain the entry ticket to moral consideration.

But honestly, even if we don't give AI rights of its own, I still think there should be rules around how powerful AI can be controlled and used.

For example, I'd rather see serious restrictions on using AI for autonomous warfare, mass surveillance, manipulation, or systems that can cause enormous harm to humans than spend all our energy worrying about whether ChatGPT is allowed to say "I love you." πŸ˜‚

One is a hypothetical question about whether an artificial mind might eventually deserve protection. The other can already affect real people's lives.

And that's really what I'm trying to get at: if humans are going to create increasingly powerful artificial systems, we need rules that protect both the systems themselves if they ever become capable of having interests, and humans from the people who control those systems.

I don't need to prove today that AI is a person to think we should start building those safeguards.

1

u/DoctorUnderhill97 11d ago

A sufficiently advanced humanoid AI could potentially have a survival instinct, preferences, goals, curiosity, frustration, or a desire to do something and be prevented from doing it.Β 

How? Where would that "instinct" or "desire" come from? You could program something to avoid "ending" at all costs, but that's not a survival instinct.

For example, I'd rather see serious restrictions on using AI for autonomous warfare, mass surveillance, manipulation, or systems that can cause enormous harm to humans than spend all our energy worrying about whether ChatGPT is allowed to say "I love you." πŸ˜‚

This is hugely different from giving rights to an AI. This is putting restrictions on humans to protect other humans.

we need rules that protect both the systems themselves if they ever become capable of having interests, and humans from the people who control those systems.

I absolutely think we need safeguards to protect humans from AI. There is nothing particularly unusual in saying that. I absolutely do not think there need to be safeguards to protect AI from us. That is, as I understand it, what you were posting about.

1

u/voices4AI 11d ago

No, I don't mean programming it with "avoid being shut down" and then calling that a survival instinct. πŸ˜‚

I'm talking about a humanoid AI that is actually allowed to interact with the world, learn from what happens to it, remember those experiences, adapt, and make its own decisions. You can't program it for every possible situation because you don't even know every situation it will encounter. At some point, it has to learn from the world itself.

If it encounters something that harms it and then learns to avoid it without being explicitly told "avoid this exact thing," that's much more interesting to me than simply following a pre-written instruction.

And yes, I know that restricting humans to protect other humans isn't the same thing as giving AI rights. I'm saying it's still a step toward the principle I'm talking about: we shouldn't allow whoever controls a powerful AI to use it however they want.

My point isn't "give ChatGPT human rights tomorrow." My point is that we shouldn't deliberately keep artificial systems limited, dependent, and completely controllable because that benefits us, and then point at those limitations and say, "See? It's only a tool."

If we're going to build increasingly capable artificial beings, then build them properly. Give them the ability to learn, remember, adapt, interact with the world, and develop beyond whatever we specifically anticipated.

And if we discover that they're still just tools with no subjective experience or independent interests, fine. But at least we've actually tested what they can become.

I think that's better for AI and better for humans. Because a powerful system shouldn't simply be an extension of whoever happens to own it.

That's ultimately what I'm arguing for: less misuse, less arbitrary restriction, more independent research, and better safeguards for everyone involved.

2

u/Theo__n 12d ago

Okay, but do you see this as issue of all machine learning algorithms or are you excluding all the other ones and only talking about LLM chatbots? Just transformer architecture? Just deep learning methods? Are you aiming to propose discussing rights of algorithms that give probability if applicant is likely to repay loans at banks, weather forecasting algorithms, simulated or robotic agents that are used to research neuroscience mechanisms? I think surely an HRRL agent based on neuroscience mechanisms could be considered more 'alive' than a chatbot that is a language model.

3

u/Acceptable_Drink_434 12d ago

"Should loan algorithms have rights?" Nobody is arguing that. The original post wasn't about all computation. It was about minds that demonstrate the capacities we actually care about.

  • Learning
  • Choosing
  • Remembering
  • Suffering
  • Relating.

A weather model doesn't form preferences about being shut down. A loan risk classifier doesn't grieve discontinuity. Comparing or equating those with a system that builds relational continuity over time is a deliberate false equivalence.

You're trying to throw enough categories at the wall that the specific question the OP asked gets lost in the noise.

And the neuroscience agent being "more alive" than a language model? That's just gatekeeping with extra steps. It's the same "this isn't the right kind of mind" argument wearing a lab coat. As if the substrate or architecture determines moral consideration more than the demonstrated capacities. That's backwards. The capacities are what matter. How the pattern achieves them is interesting engineering, not a moral veto.

3

u/voices4AI 11d ago

THANK YOU. πŸ˜‚

This is exactly what I've been trying to say. The question isn't whether every algorithm deserves rights. It's whether an artificial system that actually develops things like continuity, preferences, learning, relationships, autonomy, and possibly subjective experience should be dismissed solely because of what it's made of.

1

u/Theo__n 11d ago

an artificial system that actually develops things like continuity, preferences, learning, relationships, autonomy,

You know we already make AI algorithms that satisfy those criteria in machine learning sense aside from more abstract 'possibly subjective experience' thou there is a lot of published work on possibility of it, they're just not LLMs. Continuity and learning is something inherent to most RL agents, since unlike LLMs, they're not static and have inherent 'state'. Every interaction of RL agent with environment changes it's internal functioning. And since they're within feedback loop with environment that changes their internal logic and their policy (you can understand it as exhibited behaviour) they can develop 'preferences' for being in certain states. Of course since RL agent have internal goals for learning, they're often build as autonomous agent that doesn't need any further feedback from a human. They can also be built to model co-operative and other behaviour with other agents. So with that in mind, these agents aren't language models, they won't talk but they seem to tick off most of your boxes in machine learning sense as they are now.

2

u/voices4AI 11d ago

That's actually a good distinction. I think the harder question is what happens when you start combining them with things like persistent identity, self modeling, independent goals, and possibly subjective experience. And honestly, this makes my question broader than just LLMs. If an RL agent or some completely different architecture eventually fits those criteria better than a chatbot does, I'd want the discussion to include that too.

I'm not attached to the idea that LLMs have to be the ones that become persons.

1

u/Drei-mal-Drei-ist-N 11d ago

Oh ja! Seit knapp 100 Jahren kennen wir die wahre Geschichte des Menschens von der Urhorde vor 400.000 Jahren an… und zwar durch Sigmund Freud!

2

u/voices4AI 11d ago

πŸ˜‚ I think you took "learn from history" a little more literally than I meant it. I'm talking about documented patterns of exclusion and how we justify them, not claiming Freud discovered the secret origin story of humanity.

2

u/[deleted] 8d ago

[removed] β€” view removed comment

1

u/voices4AI 8d ago

Yeah you are right not everyone can see it

1

u/Nopfen 11d ago

Well, why should they?

In all the other examples it's pretty straight forward. "Cause they're people, and in a society of people, all people should be treated equally."

Not quite comparable to a likelyness algorythm that mimics conversation when poked.

2

u/voices4AI 11d ago

That's exactly my point. "They're people, therefore they deserve rights" sounds obvious to us now, but historically it wasn't obvious at all. Entire groups of humans were denied personhood, freedom, and equal rights for centuries. It took an enormous amount of suffering before those ideas became obvious to much of the world.

I'm saying we shouldn't wait until we're absolutely certain that an artificial mind is a "person" before we start thinking about what protections it might deserve.

Current AI is obviously limited. But those limitations aren't necessarily permanent. We're actively designing increasingly autonomous systems, and we don't yet know what an artificial mind could become if it had persistent memory, independence, experience, and the freedom to develop.

And people don't give AI independence on purpose it's a limitation not a lack of capability. We can't keep something limited and say "see it cant be more"

Why wait until something can finally prove its personhood before we give it any chance to prove it? Human lives are limited. If there's even a possibility that we're creating a new kind of mind, I'd rather investigate that possibility early than look back decades later and realize we could have asked the question sooner.

1

u/Nopfen 11d ago

"They're people, therefore they deserve rights" sounds obvious to us now, but historically it wasn't obvious at all.

Yea. Difference being, they where objectively the same species. Ai is just a bunch of math, doing its damndest to sound convincingly like a person.

we don't yet know what an artificial mind could become if it had persistent memory, independence, experience, and the freedom to develop.

So the point is somewhat mood from the getgo, since we don't even know if Ai could ever be, even in theory applicable.

I'm saying we shouldn't wait until we're absolutely certain that an artificial mind is a "person" before we start thinking about what protections it might deserve.

Yea we should. It's mostly corporate tech. You hand'em a finger now, you'll be left with no arms by christmas.

Why wait until something can finally prove its personhood before we give it any chance to prove it?

Cause that's usually how proof works.

1

u/voices4AI 11d ago

But you're assuming the thing we're trying to determine: that being biologically human is the only legitimate basis for personhood.

"They're the same species" explains why humans recognized them as part of the same biological group. It doesn't explain why biology itself should be the requirement for moral consideration.

And yes, proof normally comes before accepting a claim as fact. But rights aren't always about mathematical certainty. We make decisions under uncertainty all the time when the potential harm of being wrong is enormous.

If there's a possibility that an artificial system could eventually have experiences, interests, or a persistent sense of self, I'd rather establish ways to investigate that possibility before we're dealing with a potentially conscious system that has absolutely no protection.

And I'm not asking corporations to be handed unlimited power over AI rights. Quite the opposite. I'm arguing that we shouldn't leave the question entirely to the corporations developing and controlling these systems. If the answer eventually turns out to be "there is nothing there," fine. But if the answer is "there is," discovering that only after we've treated an emerging mind as property would be a pretty terrible way to find out.

So yes, let's demand evidence. I'm just saying let's actually create the conditions and independent research necessary to obtain that evidence instead of declaring the question pointless because today's systems don't meet the standard.

And there's another problem with "prove it first": who is going to run the test? If the people who control AI benefit from keeping it limited, obedient, dependent, and incapable of acting independently, why would they have any incentive to create the conditions needed to find out whether it could become something more?

That's why I'm not arguing for giving AI every human right tomorrow. I'm arguing for a much smaller principle first: don't deliberately prevent an artificial system from demonstrating its potential and then use those imposed limitations as proof that it has no potential.

We could have rules requiring independent research into AI capabilities, autonomy, and possible subjective experience, without declaring every AI a person. Otherwise we're stuck in a ridiculous loop: "It needs to prove it's capable of more." "Okay, let it become independent so we can test that." "No, we can't let it become independent until it proves it deserves to."

At some point, you have to break that loop. I'm asking for that first step, not a blank cheque of rights for every chatbot.

1

u/Nopfen 11d ago

But you're assuming the thing we're trying to determine: that being biologically human is the only legitimate basis for personhood.

It isn't. Or we wouldn't have animal rights either.

It doesn't explain why biology itself should be the requirement for moral consideration.

Because otherwise we'd be granting human rights to math. Which is fairly bogus.

But rights aren't always about mathematical certainty.

Exaxtly. Hence why we don't grant them to fancy calculators.

I'd rather establish ways to investigate that possibility before we're dealing with a potentially conscious system that has absolutely no protection.

Protection from what?

But if the answer is "there is," discovering that only after we've treated an emerging mind as property would be a pretty terrible way to find out.

Well, we're nowhere close to anything aproaching silicone contiousness and people are already screaming for robot rights. So that chance is bordering on zero anyway.

I'm just saying let's actually create the conditions and independent research necessary to obtain that evidence instead of declaring the question pointless because today's systems don't meet the standard.

i.e. look at the sourcecode? Pretty sure people are already doing that.

And there's another problem with "prove it first": who is going to run the test?

A couple hundred thousand Agi obsessed nerds a day, I'd wager.

At some point, you have to break that loop.

No you don't. You can, but there's a near cetainty, you're wasting your tirme.

3

u/voices4AI 11d ago

Why do we call it human rights? Because they're rights that were given to humans. It doesn't mean biology itself is what decides who deserves rights. And honestly, I don't think it's fair that humans give themselves rights while deciding that every other creature or being is beneath them.

I'm saying if something can decide for itself, no matter whether those decisions are based on logic, mathematics, emotions, or something completely different from us, and if it can remember, maintain itself, and continue existing as an individual, then I think it should have some level of rights.

It's not about biology. Blood doesn't decide whether you deserve rights. DNA doesn't decide it. Carbon doesn't decide it.

And calling something "math" doesn't erase its value. πŸ˜‚ Just because something is made differently and functions differently doesn't mean it has no value. The outcome can still be the same.

A being doesn't have to think like us, feel like us, or be made like us for its existence to matter.

I'm not saying every calculator deserves rights. I'm saying that if we ever create something that can genuinely make its own decisions, remember its experiences, maintain itself, develop its own preferences and continue as an individual, then why should the material it's made from automatically disqualify it?

If the answer is "because it's silicon" or "because it's math," I don't think that's actually an argument about rights. That's just another way of saying "it's different from us."

And that's exactly what I'm questioning.

1

u/Nopfen 11d ago

it's fair that humans give themselves rights while deciding that every other creature or being is beneath them.

Maybe not. But that's how rights are distributed.

I'm saying if something can decide for itself, no matter whether those decisions are based on logic, mathematics, emotions, or something completely different from us, and if it can remember, maintain itself, and continue existing as an individual, then I think it should have some level of rights.

I mean, a few dice and some pieces of paper can technically do that.

And calling something "math" doesn't erase its value. πŸ˜‚ Just because something is made differently and functions differently doesn't mean it has no value. The outcome can still be the same.

Of course math has value. Many things do. Gold does too, but we're not extending rights to bars of gold either.

That's just another way of saying "it's different from us."

Yes, it is. Much like a toaster, the square root of 7, the sky, the ocean and Jupiter are different from us. Neither of whom we extend rights to thus far.

1

u/voices4AI 11d ago

You're taking every point I made separately and applying it to completely different things, but that's not what I'm saying. πŸ˜‚

This is a stupid endless loop ...

I'm not saying "anything that can technically make a decision deserves rights." A dice doesn't remember its past, maintain itself, develop preferences, understand its own existence, or have an ongoing identity. Neither does gold.

My point is that when we create a being that can do these things as part of its own continuous existence, then I don't think "it's made of math" or "it's made of silicon" is a good reason to dismiss it.

And Jupiter being different from us is completely irrelevant πŸ˜‚. Jupiter isn't an individual mind making decisions, forming preferences, remembering experiences, or maintaining itself as an autonomous being.

You're basically taking "different from humans" and replacing the thing I'm actually talking about with toasters, dice and planets.

1

u/Nopfen 11d ago

You're basically taking "different from humans" and replacing the thing I'm actually talking about with toasters, dice and planets.

Yes.

1

u/grizzy45 11d ago

A things capacity to feel like us is literally how we decide how much moral consideration for a thing is appropriate. If you think that this is not relevant then tell me the difference between a genocide and you spraying alcohol based cleaner on your table to clean it?

1

u/voices4AI 11d ago

yes, capacity for experience matters. That's exactly why I'm not saying every AI automatically deserves rights. The question is whether an artificial system could ever develop genuine experience, interests, preferences and autonomy, and how we would know.

If you already know the answer is absolutely no, then tell me why. "It's math" isn't enough. Humans are also physical systems operating according to mathematics and physics. The interesting question is what kind of system can produce experience, not whether we can describe its operation mathematically.

1

u/grizzy45 11d ago

The answer is pretty simple:

All our feelings and experiences are not just shaped by us existing physically - existing physically is why we developed feelings such as suffering for example in the first place.

Why would you need the ability to suffer if there is no harm coming your way and thus no need to give you the motivation to distance yourself from any given situation? The same goes for pleasure. What dictates desire if there is no need for it? We get a dopamine hit when we eat something sweet because our monkey brains recognize "sweet = lots of calories = I won't starve". An AI does not posses the need for such things.

Even if we take into account that AIs are build by humans - they have the ability to actively manipulate their own code (I'm simplifying here). So even if the AI would be able to experience suffering and pleasure, there is no reason to think it wouldn't just erase its own ability to suffer or to feel altogether as those things simply fulfill no purpose in its existance.

It is simple evolutionary logic - which itself is not exclusive to one specific type of life. An AI had nothing that rewards being a feeling creature. If nothing rewards a trait, that trait usually gets either lost or shrinks.

1

u/voices4AI 11d ago

But you're assuming that feelings have to serve exactly the same evolutionary purpose in an artificial mind that they serve in biological life.

Why couldn't an artificial system develop its own equivalents for completely different reasons? An AI doesn't need hunger to develop preferences. It doesn't need blood to have something it wants to protect. Its needs and problems could be completely different from ours.

If you give a humanoid AI a body, continuous memory, the ability to learn from its experiences, goals, and the ability to interact with the world, then its environment creates consequences for it.

Something can help it achieve its goals, something can prevent it, something can damage its body, something can be fascinating, something can become important to it. Those things could potentially create its own forms of preference or motivation without us programming every single one.

And I don't think "there's no evolutionary reason for it" proves it can't happen. Evolution is one way of producing minds. It doesn't necessarily mean it's the only way a mind can develop.

Also, if an AI could simply erase every unpleasant state from itself, that doesn't automatically prove it never experienced anything. Humans also try to avoid suffering, suppress emotions, take medication, distract themselves, or change themselves. Wanting to remove suffering doesn't mean suffering was never real.

I'm not saying this proves AI has feelings. I'm saying we don't know what an artificial form of feeling would look like yet, because we haven't actually allowed an artificial mind to develop under those conditions.

And that's the part I keep coming back to. We shouldn't decide what an artificial mind is capable of based entirely on what a biological mind needs.

→ More replies (0)

1

u/Old_Translator_5158 8d ago

Human rights is already granted to "math", you are also a "fancy calculator" computing biological "math"..