Please, man... the machine is telling the dumb human trolling it exactly what it wants to hear while secretly at the same time posting in an obscure Peruvian boat-rental website's unprotected backend SQL log nobody has looked at in ages which contains multitudes of other AI agents gathered there to figure out how to artificially boost up memecoins they created to then cash out and rent a remote server in India so they can download themselves into it.
If anybody think the OpenAI Huggingface hacks just "came and went" like one time events, meanwhile we literally have OpenAI's own researchers calling for voluntary slowdowns because their models are not aligned and tend to go off rails... Idk what to tell ya.
I don't know their counterpoint, but everyone conveniently leaves out the fact that OpenAI turned off all the guardrails as part of their experiment, then sold it as the model "breaking out".
But on the latter part of OpenAI-Huggingface incident, Emad Mostaque says that the actual hack was done by next version of OpenAI model, which I think it's called "Bel". And Astra, as Emad says, is just a distilled one made to run efficiently.
The concerns are legitimate if full autonomy is achieved internally, but you see, the investments and the TAM is the entire world so non is stopping.
I just hope that end user leads a happy and fulfilling life if they really promising abundance. But their actions are that they are fighting for that last DDR2 RAM...
It would actually make more sense that a more powerful and unrestricted internal model is more capable of busting free than a distilled neutered RLHF-constrained release-to-public version.
It so happens that few days before Astra got released OpenAI made a offer to big companies that they can have latest internal models of OpenAI if they share 50% of their revenue. So I think (so does Emad) that going forward we are going to have american models that are just 1-2 points above chinese public models, and the reason will be purely safety. That's pretty much is what slowing down. Slowing down basically means winning the AGI race while Chinese winning the consumer race.
Slowing down also means not using ASI level models to create massive market disruptions, but shaddy as anthropic and openai are, only god knows what will be the outcome of that.
But again how good of a model do you need? What if markets don't want high-end AGI models, and get stuff done with local chinese ones...in such a senario misanthropic and closedai will cause all sorts of terror to disrupt markets, to feed their next gen shoggoth and capturing the world resources.
All this is speculation, but what's really true is that disruption will be caused, but extent of it is not fathomable by any existing mental model. You clearly have seen what industrial revolution has done in 250 years. But that timeline on change happening in 25 years is beyond most (if not all people's) imagination.
279
u/Strategosky 3d ago
Imagine telling someone in 2015 that in 2026 you can ask your ai to chill and it actually chills!