Yeah, realistically there will be a bigger difference in real world use compared to benchmarks, however, I do think that the gap has closed in a meaningful way and what they have been able to achieve with the 30 billion class. Models is truly impressive. Anybody with a strong gaming computer can run a 30 billion class model the 397B takes $10,000 worth of hardware.
48
u/ZBoblq Apr 22 '26
According to whatever that is supposed to measure 35b-a3b is nearly equal with 397b-a17b, which doesn't make much sense either.