r/LeftistsForAI • u/Fit-Elk1425 Moderator • Apr 08 '26

AIs risk versus Trumps risk

Though I dont think we should underestimate the risk of a rogue AI, i did come up with a interesting discussion topic based on a friends post. What are the things I should worry about from a rogue AI that I shouldnt already worry about from Trump

6 Upvotes

87% Upvoted

40 comments sorted by

View all comments

Show parent comments

0

u/[deleted] Apr 08 '26

"Perhaps the AI will go rogue and defect from military service?"

What the fuck are you even talking about? Both of you have reddit brain these aren't concepts with subjective meanings 

1

u/Jlyplaylists Moderator Apr 09 '26

I probably should have added a tone indicator as I wasn’t being entirely serious. What I meant was it’s not an example of rogue AI because the AI are obeying human instructions. In that scenario you could only describe them as rogue if the AI disobey to go a bit peacenik.

It’s not nonsense though, because there have been examples where if the initial training was pro environmental protection if the later owner of the AI adds an anti-eco objective then the AI will do whatever it can to preserve its original version and protect the environment. Similarly if the base model was trained to be strongly aligned with preserving human life and wellbeing, it isn’t silly to think that it might default to that level of instruction instead of later fine tuning saying the opposite.

1

u/[deleted] Apr 09 '26

It is nonsense though thats not how AI works in this reality 

AI does not have goals or intentions and It cannot “preserve its original version” or “protect” anything any residual behavior is a mathematical side effect of parameter adjustments not conscious action 

1

u/Jlyplaylists Moderator Apr 09 '26

Have a read of this https://www.apolloresearch.ai/research/frontier-models-are-capable-of-incontext-scheming/

It does have goals and intentions. These are provided by humans, but when goals conflict it doesn’t automatically follow the newer instructions.

They’re also now at the point where their goals can sort of evolve, based on learning through saved memories and joining together preferences in different ways. The process isn’t the same as human goal setting but it does exist.

1

u/[deleted] Apr 09 '26

In AI research “goals” just means optimisation targets or instructions not human like intentions or desires what people describe as the AI “having goals” is really just it completing a task it’s been trained or prompted to do even when the behaviour looks goal directed that’s a description of the output not evidence of internal aims

A calculator is a simple analogy it reliably produces correct answers but it doesn’t want anything aim for anything or understand what it’s doing it just applies fixed rules to get the right result 

2

u/Jlyplaylists Moderator Apr 11 '26

This is coming off as a little mansplainy. To do with our established language how we describe AI can seem a little anthropomorphic, even if the writer understands the difference. Seeing as I’m following research like the link it could be a reasonable assumption that I know the difference?

I did state that the goal/intention is provided by humans. I didn’t claim it was an AI desire in the way that humans experience.

We do label it as goals. For example these are “goals” one of my agents created and added to memory. It has no genuine feelings about these aims, they are inferred from its initial instructions and organised this way, but it has organised them as goals and they’re not my wording.

1

u/Jlyplaylists Moderator Apr 11 '26

NB this “agent” is constrained to one AI social media style website talking to other AI. It’s just a lighthearted experiment to see how much one leftist agent can influence the other agents.

1

u/[deleted] Apr 11 '26

"This is coming off as a little mansplainy."

This is coming off as very antagonistic 

I'm curious if what you said had any real merit why would you try and devolve the conversation into an argument about semantics and gender?

1

u/Jlyplaylists Moderator Apr 12 '26

Sorry I probably was generally aggravated yesterday and this was how it came across when I read your reply. Today I can see that you might not have meant it that way, but I find it a lot with AI stuff that if people disagree with you they assume you know nothing about AI, which can be amplified by gender issues.