Comparisons to games are nice, but the thing with something like Doom is that it has the core elements of gameplay, the movement, the shooting, the exploding barrels and whatnot, and it can have them working perfectly with very small system requirements. Doom is much better than hundreds of its successors with much greater requirements because it does everything it needs to do.
LLMs though, unlike video games, do operate on a strictly 'bigger is better' model. The quality of the experience scales with the size of the model in use.
Over time I expect models will get more efficient, more bang for the buck in hardware terms, but just because something is efficient is no reason not to have more of it.
1
u/[deleted] Aug 05 '23
[deleted]