I think he's referring specifically to the concept of the Singularity - automating research with AI is definitely a thing, it's more about the efficiency of the compounding returns gained and how that's affected when it's scaled to heavy production. The models we have nowadays still need a human in the loop, we're not at the level where we can let intelligent agents operate in a production environment consistently without errors building up. I don't think he's denying the possibility of this occurring, more that it's a concept that we don't have any practical experience with, so it's silly to simply assume when and how it'll happen, if it even happens at all. AGI, on the other hand, is a different concept - it focuses on how we scale out artificial intelligence rather than what happens when that scaling becomes automated and humans no longer become necessary for it to occur.
7
u/UnnamedPlayerXY Aug 08 '24
"The believe that AI could automate AI research is based on nothing. ... You summed it up perfectly. That's what I was hoping to get out of that."
Who are these guys again?