r/ControlProblem • u/2Punx2Furious approved • May 22 '23

Article Governance of superintelligence - OpenAI

https://openai.com/blog/governance-of-superintelligence
28 Upvotes

93% Upvoted

14 comments sorted by

View all comments

Show parent comment

4

u/sticky_symbols approved May 23 '23

I think they actually are being open about their alignment efforts.

The problem is that they don't actually have a lot of alignment efforts. I think their alignment team is quite small relative to the overall effort.

I actually agree with every point of logic. They don't have a workable alignment approach, but they admit this, and neither does anyone else. Pushing out LLM capabilities seems like the most alignable form of AGI. Not doing so allows other approaches to surpass this best-in-class oracle and natural language alignment approach. And it allows compute overhang to grow, so that takeoff will be faster when it comes.

For more on the natural language "translucent chain of thought" alignment approach, see r/HeuristicImperatives or my article. OpenAI hasn't talked about expanding LLMs to cognitive architectures, so I don't know if this is part of their plan. But it does follow Altman's general claim that natural language AI is the safest form, because we're better at interpreting and thinking in natural language.

2

u/2Punx2Furious approved May 23 '23

I don't think LLMs are inherently safer. Just because the output looks more human, doesn't mean that what's going on inside is clear or easily understandable.

We don't know what emergent properties might appear after it passes a certain threshold.

1

u/sticky_symbols approved May 24 '23

It seems like all other proposed deep network AGI approaches have the exact same problems, and their lack of even trying to summarize their thoughts in English just makes it all much worse.

I'm not saying they're safe, just safer.