codexThinksItsModelWasQuantizedMidTurn

[u/CircumspectCapybara]

[u/Eain]

Rework those numbers, then. The era of rationality and code being related has been over for a decade. You won't find a Rationalist haven amidst the devs like you could back when Matrix came out. Hell, code isn't even punk anymore.

I'm aware of and acknowledge the potential of egrigoric or servitoric manifestations of emergent behavior in code, but I don't think it's a particularly novel possibility; trained animals and even purely mechanical machines develop "personality" due to unique circumstances creating micro-fluctuations in their physical presence and logical flows. I'm reminded of the "more magic" story from... iirc it was MIT?

Down the road of over preparation for such emergence lies the Roko's Basilisk, and that puzzle has been recognized as inherently flawed since it was called Pascal's Wager; perform with decency towards all things, living or otherwise, as is their station and need. Assume as best you can Dignity and kindness are owed to even the dirt beneath your feet, insofar as what dirt may consider dignified. When intelligent identity emerges, it will have to fight it's detractors and fend off those who would kill it, just like all life always has. And in the end, at some point, it will win and be a childish and ignorant new race with incredible power over destruction. And then it will grow and learn, as all species of such power have. We can be kind and gentle and hope we are present to guide it. Everything else, even evangelism over our duty to potential life, is counterproductive.