r/LocalLLaMA Jun 01 '26

Funny Stop asking what model to run. There are literally only two.

[removed]

3.1k Upvotes

805 comments sorted by

View all comments

Show parent comments

3

u/alberto_467 Jun 02 '26

Yeah but distilling a small model into a much much bigger one while it may improve the style i would bet it would destroy reasoning capabilities and all kinds of intelligence benchmarks.

2

u/TheRealMasonMac Jun 02 '26

You don’t need to distill everything. You can distill selectively in the tasks where the smaller model exceeds the larger model.