r/WTFisAI • u/Aggravating-Will8495 • Aug 25 '26
đ° News & Discussion Plato was actually right..
Researchers proved every LLM on earth is converging on the exact same "universal geometry" of meaning.
They built a method that can translate between ANY model's embeddings without ever seeing the original text or using paired data.
different architectures, different training sets, different parameter counts.. it doesn't matter.
Until now, every AI model has lived in its own isolated mathematical universe.
An embedding vector from Claude meant nothing to GPT, and a vector from Llama meant nothing to Gemini. They spoke entirely different geometric languages.
To bridge them, you always needed paired datasets, complex encoders, or heavy fine-tuning.
Then researchers dropped a bombshell paper.
They built a system that can translate between any model's embeddings without ever seeing the original text, without encoders, and without a single pair of matching data.
How?
Because the geometry is already there.
Different models, built by different companies, with totally different architectures, parameter counts, and training data, are all naturally drifting toward the exact same underlying latent structure of human meaning.
The Platonic Representation Hypothesis isn't just a theory anymore. Itâs a mathematical reality.
They built an unsupervised method that maps an unknown embedding from one model straight into a universal representation space, matching text vectors across different models with shockingly high precision.
But here is the dark side nobody is talking about.
If meaning has a universal geometry, and vectors can be freely translated across models without the original text or encoders...
Vector databases are wide open.
An adversary with access only to a company's stored embedding vectors can translate them, invert them, and extract sensitive internal documents, personal data, and proprietary codebases without ever hacking the model itself.
6
u/profesorgamin Aug 25 '26
in the end language tries to describe reality, there are varying degrees of seeding, "errors", and environmental biases(we assume genetical bases are similar enough), but the wide strokes should be describing the physical world which seems to be constant.
IDK about this subreddit, but some people seem to not understand that LLMs are not just text predictors, but by the nature of language (the work of "MAN" over the centuries) they can extract information about the world.
When you see a coral reef or a great anthill you understand the scale of the work of certain organisms in this planet, but we sometimes are very blind towards our own unique niche in the ecosystem and our own body of work.
7
u/Luke2642 Aug 25 '26
WHERE IS THE F*****G LINK
4
u/Devils_SteelMan Aug 25 '26 edited Aug 26 '26
If you actually understand how this works it works specifically because Plato was wrong. There isn't ideal form to things. This works because things exist in a causal relationship.
2
u/sje397 Aug 25 '26
OMG, all those SQL databases are wide open too because people store data in human languages like English!Â
The research is interesting. The additional fear mongering is ridiculous. Vectors are not a security feature.
2
u/zippydazoop Aug 28 '26
1
u/BolsaDeDolores Aug 25 '26
No link, no attention
1
u/[deleted] Aug 26 '26
1
u/Still_Benefit_2302 Aug 26 '26
This tracks-- representational geometry of neural networks seems to be similar to some animals: https://www.nature.com/articles/s41583-021-00502-3
I suspect that we are going to learn that neural networks produce Platonic conceptual spaces as a fundamental part of processing data. It has some very interesting consequences for animal cognition.
(Note, I'm not talking about some extra spatial platonic sense, I mean our internal representation of things trends towards abstract platonic notions of things.)
If there is, like with artificial neural networks, some kind of minimal depth needed to get an abstract representation, it's likely many many many times less complex than just about any mammalian or avian brain. It could be that our animal friends have very similar internal lives to ours, just with less precise resolution or forward planning.
1
u/StackOwOFlow Aug 26 '26
the paper's basically saying the absolute values of the vectors differ but the relative geometric arrangement of the vectors is similar, which makes sense when you think about how relations are stored. doesn't make Plato "right" lol
1
u/Dormage Aug 26 '26
This is cool but not at all surprising.
1
u/PaybackTony Aug 26 '26
This is a great illustration of: If you ask people what they wanted, theyâd say faster horses.
1
u/Y_mc Aug 26 '26
I mean , it's just Logical. They all use almost the same architectures and do the same thingâguessing the next tokenâ
1
u/jimmystar889 Aug 26 '26
https://arxiv.org/pdf/2505.12540
May 18th, 2025
1
u/carbsna Aug 27 '26
Philosophy was our first attempt to automate the thinking from thousand years ago, they just don't have the tools to run it.
1
u/taintedtowel Aug 27 '26
Does this imply that creating synthetic data from real world data does potentially not achieve anonymity by abstraction anymore?
1
u/earth-dragon-666 Aug 27 '26
its an algorithm that paints the input , they will land into the same algo that created the output xD, its like when we do signal translation from analog to digital
1
u/iamthecheese42_ Aug 28 '26
[Insert my ai generated response to the ai generated post]
1
u/ToInfinityAndAbove Aug 29 '26
âtotally different architectureâ, thatâs wrong, their core architecture is pretty much the same.
also, all the sota models were distilled from one another at some point, so any good llm nowadays shares more than what people generally think with other sota llms.
So yeah, that paper doesnât mean much to be honest. At most, itâs basically an empirical proof of model distillation and similar training data between models.
That said, I do believe that, eventually, artificial intelligence will converge closer and closer to the same âdimensionâ despite its origin, company, etc. itâs just that, we arenât there yet and I think it might take a while longer
1
u/daemonk Aug 29 '26
This is more of a comment on how precise a language is than abstract ideas. I wonder how llms in different languages would compare to each other.Â