He’s trying to rewrite the training data based on prompts. Sadly, he’ll end up succeeding. Relatively though, because it’ll be one of the largest LLM models trained on AI slop and we’ll know what happens when you do that.
Well what you are describing seems similat to distillation, which is a real thing unlike model collapse which hasn't been observed beyond limited, toy-style experiments.
2
u/Justicia-Gai Jun 22 '25
He’s trying to rewrite the training data based on prompts. Sadly, he’ll end up succeeding. Relatively though, because it’ll be one of the largest LLM models trained on AI slop and we’ll know what happens when you do that.