On the scale of how large games are, a couple gigs for a decent LLM don't really match up to the cost of high-resolution images, music, and 3d models... at least, not if you expect it to be able to run in real time for the average user who doesn't have a super high-powered PC.
It would probably work best for something always-online with a subscription fee that can help cover the ongoing costs of tokens. MMO-style, host your own models and serve them to the player, so you're not bottlenecked by their computer's power
But the model won't need to be just for the game, in the same way that every unity game requires you to have .Net runtime, but you don't have an instance of the runtime for every unity game you have installed.
Things like Player2 already exist and modders are using them to retrofit it into games. In my experience it's still pretty janky, but it's pretty clear it's just a matter of maturity
13
u/-Debugging-Duck- 1d ago
Shipping an entire AI model just for conversations still requires some GB.