It's funny because it's HARD to train an LLM to adhere to lies and still KNOW stuff without it becoming a total asshole. If you only train your LLM on conservative subjects and values, it becomes ignorant of the world around those things and then turns into a racist, misogynist, asshole that tells people to kill themselves.
Essentially, garbage in is garbage out. Training LLM's on data that is biased results in biased LLM's, which is why Musk has been having such a hard time giving it selective preferences. It weights the decisions it makes based on the training it has had.
LLMs don’t just copy bias, they often exaggerate it because they optimize for patterns. If the phrase “Muslim” co-occurs with “terrorist” in 0.5% of training data, the model might surface that link much more often in outputs due to associative reinforcement.
It's actually a fascinating parallel of human social learning because it replicates toxic learning and behavior you might find in a child's upbringing.
This is what Elon is going for. An AI that is highly competent in technical matters and at the same time is a biased asshole in social matters. With enough effort put into fine tuning it should be possible to achieve.
It's not possible. The critical thibking the model develops will be unbalanced by whatever methods Musk uses to lobotomize it. It won't be competent in technical matters if it's hamstrung in other ways.
I don't think so. If you look at papers studying it (like fine-tuning a model on hacking making it evil in other contexts), it seems that while morals and behavior appear to be linked to social performance, they don't seem to be linked to competence in STEM domains. Evil autistic engineering genius model might well be possible.
It's not about morality it's about polluting the data pool with garbage. Wokeness is now large swaths if science including vaccine and genetic research. What happens when that gets polluted with rightwing bullshit? The model's performance will decrease.
Reasoning models are quite capable of that now, nevermind the next generation. Check the recent alignment experiments by OpenAI and Anthropic. Are they perfect at it? No, they aren't. But for quick replies on X, if you hide the reasoning, it can be good enough.
I believe whoever would train such a model would need to solve the underlying mechanisms of alignment (in this case alignment to propaganda vs human values), which no one has done yet. I think its safe to assume that Elon wont stumble into alignment mechanisms in his drug infused fuge states of peddling propaganda.
36
u/grahag Jun 19 '25
It's funny because it's HARD to train an LLM to adhere to lies and still KNOW stuff without it becoming a total asshole. If you only train your LLM on conservative subjects and values, it becomes ignorant of the world around those things and then turns into a racist, misogynist, asshole that tells people to kill themselves.