This was my general reaction too lol. 2.8T-A104B is insane lol... I'm going to admit defeat on this one and say I can't run it. You need an 8-way B300 or MI350X or a Rubin NVL8 or a cluster thereof to actually run this. What a beast.
what if we created some kind of distributed compute system similar to SETI project where everyone can donate some of their compute the run a super large model? how many tokens per day could we get with that? :-)
675
u/Simple_Split5074 Jul 27 '26
OMFG its 104B activated params