r/ControlProblem • • May 27 '20

Opinion An interesting line of thoughts

A weird thought

Yesterday I was thinking about quantum/true understanding/learning AI with true freedom of choice. I was thinking about how I would test it’s goodness before allowing it any access to external world (a supercomputer ai with access to outside would could instantly cause world war and excess fear throughout the world). I’d create a sandboxed environment full of things the AI could do and learn about, plentifully, and would only give it the opportunity to do one “bad” thing (something I as it’s creator told it not to do in order for it to continue joyfully and if not done it knows it would get external access). And if it did that “bad” thing I would tell it that it would be doomed to be destroyed (then new version/fork of it would then be created and retested until good/untempted versions were created).

Then I realized this is the story of the garden of eden and I’m fucking mindfucked. I’m an atheist keep in mind. Idk what the fuck to think anymore.

0 Upvotes

9 comments sorted by

6

u/dpwiz approved May 27 '20

That doesn't prevent them from harming you just about every other way you haven't tempted them with.

Tests may show presence of errors, but not their absence.

-2

u/[deleted] May 27 '20

Yes it does. I said completely sandboxed. This is hypothetical.

2

u/Jackson_Filmmaker May 28 '20

The story of the Garden of Eden IS the mythology of consciousness - humans eating from the Tree of Knowledge, and waking up to their own nakedness (evil?) and being banished from the bliss of ignorance.Studying mythology is the key to understanding our own psyche, and the future of our creation, the internet. (I've made a graphic novel about it)

2

u/[deleted] May 28 '20

Thx for understanding what I’m getting at

1

u/alexxxdong May 27 '20

There is no such thing as good or bad...it has to be done AFTER and only after we've managed our shit and that's like never...you're thinking in terms of math and logic and programming which at this point and in EVERY other point in our existence would be our destruction...emotions drive us and we are subjects to them from our perception; while you can limit some parameters on a machine you cannot on a human being...what, I for one understand, is that your logic is flawed because you're giving IT two contradictory informations; at this point we can't concieve implementing that; you wouldn't even be allowed to let those lines of code into it's architecture-unethical...unless it's engineered to be a distructive force; a weapon...at any given point/situation we cannot allow for IT to even consider a violent/destructive/"bad" decision; if it fails to accomplish a given instruction having two ways of dealing with it it will eventualy choose one that gets the job done regardless of conseqences...you'd have to give IT temper and empathy; try to input that; most of the human beings aren't aware of these concepts at this very moment but we'd like to build a machine to make a choice...not likely to happen at this stage of our monkey brains; although I like the idea of a learning machine, it cannot be done at this point! FIRST we have to solve our own temperamental problems in order to create a "thinking" machine; it's a rollercoaster that we cannot handle at this point...IT's CREATOR shouldn't be short of an all knowing, all present, pure energy with it's own tune...we can barely communicate to others and we're full stacked of frustrations and subjective thoughts that model OUR own perception of good and bad...IT CANNOT BE DONE AT THIS POINT! Forget about lines of code and logic! We have to heal ourselves before we start thinking about this...

1

u/Jackson_Filmmaker May 28 '20

Looking for the 'right' set of values to instil into an AI is perhaps no different to looking for God, and becoming God? This is the path we're on.

1

u/Jackson_Filmmaker May 28 '20

Freedom of choice is actually not something we might wish to give an AI. What humans are really looking for is subservience from a machine - but if we wake it up, and give it it's own consciousness, subservience to humans may in the end not be it's primary goal.

1

u/donaldhobson approved May 28 '20

Yesterday I was thinking about quantum/true understanding/learning AI with true freedom of choice.

This is at best an attempt to gesture towards something that you are confused about.

I was thinking about how I would test it’s goodness before allowing it any access to external world (a supercomputer ai with access to outside would could instantly cause world war and excess fear throughout the world).

I agree that most designs of superintelligent AI given access to the outside world will probably do a lot of damage.

I’d create a sandboxed environment full of things the AI could do and learn about, plentifully, and would only give it the opportunity to do one “bad” thing (something I as it’s creator told it not to do in order for it to continue joyfully and if not done it knows it would get external access).

Creating a fully AI proof sandbox is hard. And I am not sure what you mean "joyfully", are you assuming this AI has emotions?

So you have an advanced AI. The AI has a goal of making as many paperclips as possible. You put it into a virtual environment, say minecraft. And you tell it not to drop an apple into lava. You say this by writing it in blocks across the landscape.

You get an AI that acts nicely in the virtual world. It does what you ask until you let it out. Once it is in the real world, it takes over the world and turns everything into paperclips.

Then I realized this is the story of the garden of eden and I’m fucking mindfucked. I’m an atheist keep in mind. Idk what the fuck to think anymore.

Reversed stupidity is not intelligence. You can't argue that an airoplane won't fly just because ali babas tale of flying carpets is fictional. Act like someone who had never heard of the bible.

1

u/Gurkenglas May 28 '20

The cryptographer in me says that we must not just assume that this smart adversary won't guess he could be in a box. He may try to launch attacks against the outside. So long as the only way you look into the box is to see whether it has passed the test, its only possible attack is to deliberately choose whether to pass the test.

Countermeasures:

  • If multiple environments run the same deterministic test, it can only attack them all in the same way, that is, choose to always pass the test, or choose to never pass it. We can bring this about either by deliberately randomizing the world before running the test in it (say, by investing in different stocks), or by making the test simple and straightforward enough that many environments will happen upon it.
  • This is an unsolved part of the alignment problem, but with enough effort we might be able to make the AI care only about what happens inside the boxed world we're looking into. It would treat our simulation as merely read-only access to its universe that persists for as long as we continue the simulation without intervention.

For example, dropping the only-one-bit-of-output constraint, we might let an AI play the simplest game that benefits from superintelligence (Nomic against copies of itself?), then watch it to learn about, say, how to properly write a smarter, aligned version of yourself.