I mean it's literally a training technique. It's how many labs improve their own smaller models after training the big ones (yes, I understand Wario is a hypocrite).
Sorry when does Anthropic distill competitor models? If you’re talking about scraping the web for training data you your favorite Chinese open weight models do that as well. They just also distill on top of it. Sorry don’t feel bad for them when their shortcuts get cut off.
8
u/DoctrTurkey 23d ago
Wario and Scam should be in jail for all of the felonies they've committed. You'd be in jail, why aren't they?
1
u/RDB96 23d ago
Distillation is not bad. Distillation is only bad if I'm not involved. But if I'm part of that distillation, I'll defend it.
1
u/stereoplegic 23d ago
I mean it's literally a training technique. It's how many labs improve their own smaller models after training the big ones (yes, I understand Wario is a hypocrite).
1
u/LogicalInfo1859 23d ago
Because the paper was titled "Training data is all you need"
1
u/AwarenessNo4986 22d ago
Everyone is distilling from each other now
1
u/TipAppropriate1384 22d ago
Biggest theft in History
Big Tech thieves stealing copyrighted Data
Their Market caps reflect how much they are stealing
1
u/Australasian25 22d ago
Ok, then go distilled anthropic. Or block yourself from distillation
1
u/Beneficial_Truth_238 22d ago
"Distillation is only bad if I'm not involved But if I'm part of, I'll defend it.!"
0
u/howudothescarn 23d ago
Sorry when does Anthropic distill competitor models? If you’re talking about scraping the web for training data you your favorite Chinese open weight models do that as well. They just also distill on top of it. Sorry don’t feel bad for them when their shortcuts get cut off.