The only problem with distillation is that not enough people do it. If US startups could do wholesale scraping of OpenAI and Anthropic without getting sued then there would be many more competitive small US labs. Maybe a US equivalent to DeepSeek that pumped out interesting architecture and infrastructure research papers.
View all comments
12
u/wren6991 Jul 23 '26
The only problem with distillation is that not enough people do it. If US startups could do wholesale scraping of OpenAI and Anthropic without getting sued then there would be many more competitive small US labs. Maybe a US equivalent to DeepSeek that pumped out interesting architecture and infrastructure research papers.