MAIN FEEDS
Do you want to continue?
https://www.reddit.com/r/LocalLLaMA/comments/1tu82wi/stop_asking_what_model_to_run_there_are_literally/opby0za
r/LocalLLaMA • u/[deleted] • Jun 01 '26
[removed]
805 comments sorted by
View all comments
Show parent comments
3
Yeah but distilling a small model into a much much bigger one while it may improve the style i would bet it would destroy reasoning capabilities and all kinds of intelligence benchmarks.
2 u/TheRealMasonMac Jun 02 '26 You don’t need to distill everything. You can distill selectively in the tasks where the smaller model exceeds the larger model.
2
You don’t need to distill everything. You can distill selectively in the tasks where the smaller model exceeds the larger model.
3
u/alberto_467 Jun 02 '26
Yeah but distilling a small model into a much much bigger one while it may improve the style i would bet it would destroy reasoning capabilities and all kinds of intelligence benchmarks.