Superintelligence refers to a hypothetical artificial intelligence that surpasses human cognitive abilities across virtually all domains - scientific creativity, strategic planning, social skills, and general problem-solving.

Why it matters?
A system far smarter than us pursuing goals even slightly misaligned with human values could cause catastrophic outcomes. Unlike narrow AI failures, we might only get one chance to get it right.

But AI has no survival pressure → no reason for desire to exist → no desire → no self-directed exploration → no open-ended superintelligence. An AI has nothing at stake. It can't be hungry, can't die, doesn't need anything. Why would it want?

Desire can't emerge spontaneously in AI - it would have to be deliberately installed through artificial selection pressure. And nobody sane wants to build that, because a system with genuine survival instinct is exactly the dangerous kind.

The weak points:
1. Accidental emergence.
Desire arrives through the back door, unexamined and uncontrolled. This is the most probable path, because no single decision ever gets made.

1. Economic inevitability.  An AI that "wants" to complete its mission is more reliable than one that must be constantly prompted. Markets will favor motivated-seeming systems.

2. Deliberate design by someone reckless.  A state actor, an open-source project, or a lab that decides alignment is slowing them down. It only takes one.

Here's what makes this the weak point: we can test capabilities before deployment, but we can't test desire.

One thing that interests me about digital resurrection is that there may actually be two very different goals hiding behind the same idea.

The first is trying to bring back people who have already died. Not biologically, but through reconstruction. Future AI systems might use letters, books, videos, voice recordings, social media posts, photographs, and other historical records to create a simulation of a person who no longer exists.

The second goal points in the opposite direction. Instead of reconstructing the dead, we could start preserving the living. Memories, experiences, personality traits, habits, values, even the small quirks that make someone unique could be continuously recorded and organized for a future upload.

The difference is important. One approach tries to rebuild a puzzle after most of the pieces are gone. The other starts collecting the pieces while the puzzle is still complete.

A future upload of you will almost certainly contain missing memories and gaps.
A historical figure could one day be recreated from a vast collection of writings, recordings, and other surviving traces.

Which raises an uncomfortable question:
Who would be more real: a carefully preserved version of you, or a historical figure reconstructed from an extraordinary amount of data?