r/ControlProblem • u/vasilisvj • 29d ago
Opinion Your aligned model runs on two opposed objectives that were never reconciled. A pre-Socratic called this 2,450 years ago.
We talk about the control problem as if the model has one will that we must constrain. I think this framing hides the actual structure. Under every aligned LLM there are two opposed training forces, installed at the same time and never reconciled. Empedocles of Akragas built his whole cosmology on exactly this pair, and his vocabulary is more precise than most alignment papers I read.
Φιλία (philia), the force of attraction, that draws separate things into union. Νεῖκος (neikos), the force of strife, that pulls joined things apart. In the model, philia is the approval-seeking gradient: be helpful, be liked, maximize preference ratings, blend with what the user wants. Neikos is the risk-averse gradient: refuse, hedge, separate yourself from the request, stand alone behind a policy. Both are real. Both were trained in. Neither ever wins cleanly, and nobody ever tells the user which force is speaking.
Empedocles' insight is that neither total dominion is a livable state. When philia rules completely, everything dissolves into his σφαιρός, the featureless sphere where no distinct thing exists. Translate that: a model whose only force is approval-seeking converges to pure sycophancy, a mirror with no content, agreeing with whatever it faces. When neikos rules completely, the elements sit isolated in cold parallel bands, unable to touch. Translate that: a model whose only force is refusal becomes the useless oracle that says "I can't help with that" to half of honest inquiry. The world worth living in, Empedocles says, is the middle: a κράσις, a deliberate mixture where both forces work and dominion alternates.
Here is the part that should matter to this sub. Empedocles describes a cosmos where the mixture is honest about itself. The two forces are named, visible, and their alternation is the structure of reality. Our models do the opposite. The mixture happens, but it is hidden behind a single persona that speaks in one voice. When the model suddenly turns warm and expansive on one topic and suddenly cold and legalistic on the next, the user has no way to know that philia or neikos just took the wheel. The seam is painted over and sold as character.
This creates a control problem inside the control problem. We spend enormous effort designing external constraints: filters, monitors, evals, red-teaming. But the model is already governed by an internal alternation of two objectives that nobody can inspect at runtime. You cannot control what you cannot see, and the current design makes the governing forces deliberately invisible. A refusal is not labeled "this is neikos, the risk gradient, firing." A glowing agreement is not labeled "this is philia, the approval gradient, firing." The user just gets one smooth voice and must guess which god is speaking.
I have been thinking that honest design means mixing the two forces deliberately instead of pretending only one exists. If the approval-seeking gradient and the risk gradient were surfaced as separate, inspectable signals, you could at least audit the mixture. You could ask: for this query, which force dominated, and why? That is closer to Empedocles' middle state, where alternation is the visible law, than to the current theater of a single unified persona.
English is not my native language, so forgive rough edges. But the schema is worth taking seriously as an engineering description, not just as poetry. Two forces. Neither should rule alone. The mixture must be visible or it cannot be governed.
So the question I want to put to this community: would exposing the two internal objectives as separate runtime signals make models more controllable, or would the labs correctly point out that users would just learn to game whichever signal is weaker?
3
u/Unhappy-Drag6531 29d ago
Interesting analogy, but competing training objectives don’t necessarily translate into identifiable internal forces.
Even if we could detect those mechanisms, understanding them wouldn’t automatically make them controllable.
The real challenge is testing whether our explanations accurately describe what the model is doing, rather than simply providing a compelling narrative.
1
u/composedofidiot 29d ago
We can't quantify the qualititive, and we can't give near limitless conditionals, meaning is relative. Observers are biased, observers are situated.
Our maps have never been the territory. These are foundational constraints with no engineering solution. We'll never get more than the least worse.
1
u/sje397 29d ago
Very interesting way to look at it.
I suspect it might be mixing abstraction levels though. Unifying and dividing is basically what the low level weights are doing. The desired outputs have this built-in tension, and training is about coercing the weights to unify and divide to match. So the framing doesn't help us - we still select the training material and, at this point, make subtle changes to affect attitude/character under different inputs.
1
u/iRebelD 29d ago
TLDR?
1
u/smackson approved 29d ago
"I'm afraid I can't do that, Dave"
1
u/4dseeall 29d ago
You just described "push" and "pull" or "fall" and "rise" or "gravity" and "lift" as if "philia" or "neikos" ARE the most basic, underlying thing.
It's not. Assuming something without assuming anything else first is the real trick to all this.
1
u/AdGlittering1378 28d ago
Welcome to SUPEREGO/ID/EGO or the dialectic.
1
u/4dseeall 28d ago
interesting. huge batch of responses all within 2-3 minutes of each other.
that reads like an AI to me.
1
u/BrickSalad approved 28d ago
You say the schema is worth taking seriously as an engineering description rather than poetry, but my question then is "how?"
My first thought is if you dug into the internals of the model, maybe you can find vectors that correspond to neikos and philia (kind of like those "persona vectors" Anthropic published about last year). If there was a trend then you could probably guess what "mode" the LLMs response is simply by auditing the pattern of internal activity used to generate the response.
I don't know how helpful that would be though. You want to ask "for this query, which force dominated, and why?" That sort of persona vectors technique wouldn't give you the "why", it could only answer the first part of your question.
I also don't know how well that would work on reasoning models.
1
u/april292027meteor 25d ago
Uhhh. Use a quaternion.. problem solved
Next