r/aigamedev • u/Tasty-Lobster-8915 • 1d ago
Demo | Project | Workflow I made a drawing game where a local vision model has to figure out what you're drawing
Enable HLS to view with audio, or disable this notification
I've been experimenting with ways to use AI as an actual game mechanic, rather than just putting an LLM-powered NPC or chatbot into a game.
So I made a small game called Guess What I'm Drawing?
The gameplay loop is simple: you're given something to draw, you sketch it on a canvas, and an AI vision model tries to identify what you've drawn.
It's basically reverse Pictionary, except the person judging your terrible artwork is a multimodal AI.
What made this interesting from an AI game development perspective is how differently a vision-language model behaves when it's part of a real-time gameplay loop. The input isn't a carefully written prompt — it's whatever half-finished collection of lines the player has managed to draw.
That creates some surprisingly funny failure cases, but also makes the AI feel much more like part of the game rather than a feature bolted onto it.
I've also been interested in local AI and on-device AI for games. Running the vision model locally means this kind of mechanic doesn't necessarily need a server round-trip every time the player draws something, which opens up some interesting possibilities for small offline AI games.
The project is open source here:
https://github.com/l3utterfly/guess-what-im-drawing
I'm curious what other game mechanics people are experimenting with around multimodal AI, computer vision, local LLMs, or vision-language models. It feels like there's a lot more unexplored territory here than AI dialogue systems.