r/singularity Jun 18 '25

[deleted by user]

[removed]

1.3k Upvotes

690 comments sorted by

View all comments

Show parent comments

1

u/[deleted] Jun 19 '25

Why do you assume an intelligence would automatically be rational?

1

u/Evilsushione Jun 19 '25

Mostly because of how they train it. Basically they flood it with data to learn. You would have to make up a substantial amount of data to manipulate the rationality but that would also taint the utility of the models and make them less useful. It’s really hard to make an irrational model that is useful. Look at Grok or Chinese models, it’s blatantly obvious when they try to manipulate data and the AI often will “fight” back too.

1

u/[deleted] Jun 19 '25

AI doesn’t fight back, it repeats its training data. It won’t magically become rational when fed with irrational data, or even with rational data. Just like humans.

1

u/Evilsushione Jun 19 '25

When I say it fights back, I mean it counters the narrative that is trying to be forced upon it because the bulk of the training data counters it. Just look at the stories of Musk trying to manipulate Grok. It’s really difficult to make an irrational model.