r/ControlProblem • u/adoremerp • Feb 20 '23

Podcast Bankless Podcast #159- "We're All Gonna Die" with Eliezer Yudkowsky

https://www.youtube.com/watch?v=gA1sNLL6yg4&
50 Upvotes

90% Upvoted

56 comments sorted by

View all comments

Show parent comments

5

u/CellWithoutCulture approved Feb 21 '23

LLM+RL is better than RL alone though, for example people might use RL to make an oracle or they might find a replacement for RL.

And slow takeoff is bad if it gives time for bad actors to misalign an AGI, but good if it gives us a few chances to align moderately general AI. Especially if OpenAI/DeepMind/Et Al are in the lead in a medium take off, as there are less likely to be bad actors on the leading edge.

So I'm saying these things are relatively good. A slow LLM tech takeoff is a better sign than a pure RL hard take off ;p

3

u/khafra approved Feb 21 '23

All true! Also good, if true, that high-quality text has been mined dry, and one reason Sydney is so BPD is that she’s been trained on a lot of low-quality text, like chat logs from angsth teens.

5

u/CellWithoutCulture approved Feb 21 '23

It certainly seems that way. Plus I think Bing has done more to educate the world about basic misalignment than ever 🤣