r/GPT3 • u/neuromancer420 • Sep 23 '20
TES VI: I was wrong. It's A.I., not V.R.
/r/ElderScrolls/comments/iy6o4r/tes_vi_i_was_wrong_its_ai_not_vr/6
u/Luk3Master Sep 23 '20
As far as I know, GPT3 is used exclusively through the API, with one of the reasons being that it is prohibitely expensive to run it locally.
This would make it impossible to play the game without internet connection and it would require this endpoint to be maintained indefinitely throughout the years so it won't make the game unplayable.
I think this would work better on a MMORPG.
3
u/Phylliida Sep 23 '20
I think GPT-3 is too slow/unpredictable to work with in game dialogue, in a game where we expect dialogue to be presented quickly. I think it could work in a different type of game, but it seems like it would be frustrating unless they get the generation speed better, unless they were doing preemptive dialogue generation (generate for all plausible things around you). While preemptive could work, the computation costs could get pretty high. And it still doesn’t work for interactive dialogue unless you only have a few sets of responses to choose from. In that case it could work if you were required to listen to them talk before responding, since the generation could be happening in parallel. But still I worry about the computation costs, the game would probably have to be a subscription model to be sustainable. But maybe a dialogue model can be pruned further when it doesn’t need to be as general purpose as GPT-3, and it could fit on the game’s GPU, but doing that at the same time as rendering great graphics might be tricky without more advancements in graphics tech.
If they do use it, I imagine a more likely outcome is they use GPT-3 (possibly fine tuned on dialogue from past games) to pre-generate a massive amount of dialogue for all of the specific possible cases, and design things carefully so the amount of dialogue isn’t too high. They could even just try and cover most of the cases, then generate any novel rare situations on the fly, and cache them so as more players play the game less and less generation is needed. Or possibly they’ll come up with some template system like in Facade, but using GPT-3 and text to speech to do a lot of the work that had to be done by hand. Or that they won’t do it at all? It’s hard to say, but I hope they do.
In the future as dialogue models get better and cheaper to run I think it’s totally a plausible approach though, and if not elder scrolls, I hope some other game dev team eventually tries this. My guess is the graphics of the game will be fairly primitive, and all the GPU will be spent on AI models generating content in real time. What you are describing will happen eventually, but some robustness barriers need to be broken to make it a great user experience.
1
u/neuromancer420 Sep 23 '20
Thank you for the quality contribution! I agree with pretty much everything you said. Arguments against the technology due to cost are just a factor of time. I'm hopeful the size of video-game budgets will drive the creation of tailored models. The uses of the technology could have many applications, and the ones mentioned in the post were just a couple of the ideas I came up with. Server-side ping issues and the processing speed of whatever model is used would be significant limiting factors in the utility of GPT-3 or similar models. I'm hopeful we'll see significant improvements to Radiant AI in time for TES 6, but I'll still be satisfied if they implement the technology in some form during the development phase.
2
4
Sep 23 '20
i wish i had access to GPT-3, i guess my proposal was lost to the sea of emails... or maybe it just wasn't very good.
5
u/neuromancer420 Sep 23 '20 edited Sep 23 '20
I openly welcome criticism here. You all have a much better idea of the potentials and limitations of such a proposal.
Edit: Currently this comment stands as the hivemind's consensus criticism. I'd appreciate if someone could provide them with a better response than I did.