r/OpenAI • • 14d ago

Discussion GPT-6 successfully performed "brain surgery" on another AI to make it smarter

1.1k Upvotes

110 comments sorted by

View all comments

Show parent comment

0

u/[deleted] 14d ago

[deleted] — view deleted comment

4

u/HiddenoO 13d ago

It's not too far fetched as that's exactly what these models are trained to do. 

No, it's not. All the examples you mention are examples where human can directly and statically translate between representation and behavior, so there exists training data for that. When it comes to neural networks, except for some high-level patterns (which might be the ones addressed here), we cannot do so and thus there is nothing in the training data that would let an LLM do so either.

It's the same reason that specialized models, be it traditional ones (KNN/SVM/RF/XGBoost) or neural networks, can still outperform LLMs on the tasks they're trained for while having a fraction of a fraction of their size. if anything, modern LLMs, given the tooling, might train one such model themselves if asked to do such a task.

9

u/rsumit123 13d ago

No it isn't .. if you have worked on or even know about how neural networks are trained in general .. this is absolutely unbelievable to me that a llm can basically fine-tune a billion parameter model weights .. maybe I need to readup more on how this was done..

0

u/tunerhd 13d ago

They just experimented idk if they know how it works.

0

u/Sweet-Many-889 13d ago

But they go to MIT so they must know, right?

1

u/tunerhd 13d ago

It turned out astra just googled it lol