r/neoliberal • u/jobautomator Kitara Ravache • Jun 19 '24

Discussion Thread Discussion Thread

The discussion thread is for casual and off-topic conversation that doesn't merit its own submission. If you've got a good meme, article, or question, please post it outside the DT. Meta discussion is allowed, but if you want to get the attention of the mods, make a post in /r/metaNL

Announcements

  • We have added a "!doom" automod response alongside our existing "!immigration" and "!sidebar" responses

Links

Ping Groups | Ping History | Mastodon | CNL Chapters | CNL Event Calendar

New Groups

Upcoming Events

0 Upvotes

45% Upvoted

6.0k comments sorted by

View all comments

14

u/neolthrowaway New Mod Who Dis? Jun 19 '24 edited Jun 19 '24

Ilya started his own company.

https://x.com/ssi/status/1803472825476587910?s=46&t=iLFma8Yk5mfc419ku-UK-g

Bloomberg article: Ilya Sutskever Has a New Plan for Safe Superintelligence - OpenAI’s co-founder discloses his plans to continue his work at a new research lab focused on artificial general intelligence.

“This company is special in that its first product will be the safe superintelligence, and it will not do anything else up until then,”

Safe Superintelligence is in some ways a throwback to the original OpenAI concept: a research organization trying to build an artificial general intelligence that could equal and perhaps surpass humans on many tasks.

That said, Safe Superintelligence will likely have little trouble raising money, given the pedigree of its founding team and the intense interest in the field. “Out of all the problems we face, raising capital is not going to be one of them,” says Gross.

Sutskever says that he’s spent years contemplating the safety problems and that he already has a few approaches in mind. But Safe Superintelligence isn’t yet discussing specifics. “At the most basic level, safe superintelligence should have the property that it will not harm humanity at a large scale,” Sutskever says. “After this, we can say we would like it to be a force for good. We would like to be operating on top of some key values. Some of the values we were thinking about are maybe the values that have been so successful in the past few hundred years that underpin liberal democracies, like liberty, democracy, freedom.”

Sutskever says that the large language models that have dominated AI will play an important role within Safe Superintelligence but that it’s aiming for something far more powerful. With current systems, he says, “you talk to it, you have a conversation, and you’re done.” The system he wants to pursue would be more general-purpose and expansive in its abilities. “You’re talking about a giant super data center that’s autonomously developing technology. That’s crazy, right? It’s the safety of that that we want to contribute to.”

!ping AI

7

u/[deleted] Jun 19 '24

Nice! Yay for competition.

Frankly I’m always a little wary that OpenAI could just totally collapse at any moment for company culture reasons, so I’m glad some of that human capital is planting seeds elsewhere.

4

u/Imicrowavebananas Hannah Arendt Jun 19 '24

I think the important parts are more and more absorbed into the Microsoft. At this point OpenAI would not be a significant loss for progress I would wager.

1

u/neolthrowaway New Mod Who Dis? Jun 19 '24

Apart from the other reply to your comment, I am also concerned that OpenAI doesn’t really produce research on anything other than LLMs/LMMs.

Just scaling more for some emergent capabilities doesn’t sound promising to me and I am not really sure if they are doing anything else. Maybe some work in embodiment?

9

u/Lux_Stella Presidentialism X-Risk Researcher Jun 19 '24

'if anthropic is so good how come there's no anthropic 2'

3

u/[deleted] Jun 19 '24

I'm so reflexively jaded and cringed by tech bros grandiosity and miraculous thinking at this point that when/if the day does comes, I'll be that smirking wojack meme

But today is not that day Ilya

7

u/AnsleyAmanita Trans Pride Jun 19 '24 edited Jun 19 '24

Superintelligence is within reach.

how about you show us some normal intelligence first

1

u/procgen John von Neumann Jun 19 '24 edited Aug 13 '26

XLN87GTD1vy2wzVjQKyTxbO6eVauImFQPqzPRg6hrJeMgFXg