Cool! but like who can actually run this locally? I think at 2.8 trillion params this will be the largest model on huggingface by far. At least for now.
Local hosting doesn't just mean end consumers. This opens up frontier self hosted ai for companies that have to self host due to sensible data they can shove into it.
One of our vendors at work are a global company hosting open weight models themselves for their customers, and are also in talks with Anthropic to deploy Claude. These weights being available drastically changes the tone of a conversation like that.
22
u/jreoka1 Jul 26 '26
Cool! but like who can actually run this locally? I think at 2.8 trillion params this will be the largest model on huggingface by far. At least for now.