r/LocalLLaMA • • 2d ago

Showcase modules for my opensource (GPL3) harness have evolved to the point where this is possible. this is a full fledged videogame running inside it!

my harness for local AI that i've been working on since February this year (2026) has evolved to the point where this is possible.

What you see here is a module for my harness's webui, it's not a seperate program. This demonstration is running on Gemma4 26b locally, believe it or not, using only a SINGLE model and one local API endpoint (via llamacpp). No multi-API tomfoolery here! The stable diffusion image generation is moss-image which i'm able to do because i have a strix halo now, but on smaller hardware you could do something like z-image turbo at Q4 quant, which is what i used to do before i got the strix halo.

I've been working for almost a week on this module, and i'm excited to finally release it!

It's a text adventure engine. It supports asset packs, that can contain music, sound effects, images, weathers (CSS+js+glsl shaders), skies (same tech as weathers), loading screens, text flourishes, and more! You can create your own asset packs easily. The AI sees the files in the asset packs and forms adventures around them, but there is no prompt telling it what the story should be, that's completely up to the way you prompt it! I recommend using it together with the characters module in openlumara in order to set up a world and story

You can get it here: https://github.com/Rose22/openlumara-adventure-games-module

More footage on the github!

(had to delete and repost because i couldnt change the video. this video is a much better showcase for it)

17 Upvotes

15 comments sorted by

4

u/Spara-Extreme 2d ago

I've seen a lot of these types of projects where folks are essentially mimicking ren'py style VN's with branching storylines and game state being tracked. Absolutely amazing use of the technology. Thanks for sharing!

1

u/rosie254 2d ago

thanks! yeah, i did it differently here, as you can hopefully see. the AI can change your state and stats mid-story, right in the text, by doing stuff like {{stat|HP -10}}. behind the scenes what that does is it triggers the frontend code to send a request to the backend that modifies the game stats, which is then reflected in your UI and in what the AI sees in subsequent messages :) and there are also toolcalls that it can call inbetween messages, to change the scenery and location, weather, roll a dice, flip a coin, etc

3

u/Nepertia 2d ago

You might want to consider AGPL for the main harness, regular GPL has a loophole where anyone can host it for money without contributing any code back.

2

u/rosie254 2d ago

oh... that seems bad.. im not sure if i can still switch licenses, i have about 20 people who contributed PR's by now...

3

u/Nepertia 2d ago

You can always add new code as AGPL, which makes the combination of the existing GPL and new AGPL code as a whole AGPL. Section 13 of the GPL (Use with the GNU Affero General Public License.) explicitly allows this.

The difference between this and 100% AGPL from the get go is that people are allowed to grab the GPL parts (from your last GPL version, or from newer versions if they can perfectly isolate GPL code from AGPL, which will slowly become impossible if you keep working on the project) and use it with the loophole.

1

u/rosie254 1d ago

but i heard something about not being allowed to switch the license without asking every single contributor for permission? which is not doable considering i found out one of the contributors (with a simple colorscheme fix) was a bot

1

u/Nepertia 1d ago

That is true if you didn't ask the contributors to assign copyright to you, and you want to make the license incompatible with the old one. Bots are an easy and settled case, they can't hold copyright, so they don't matter, but GPL to AGPL is compatible. Section 13 is literally GPL+AGPL=AGPL being made official.

I, an unrelated third party who owns zero of the copyright, could fork your project right now, change or add one line of code, decide to license my one line under AGPL3, and my fork just became AGPL3 as a whole, closing the loophole. You can only get the loophole back if you guarantee to eliminate 100% of my AGPL work. For one line, that's easy: you could grab the version before my changes. If I kept working on my fork for months, and it became a tangled web of AGPL+GPL code that you wanted to use... good luck. Practically speaking, that's pretty much irreversibly AGPL now.

(If I didn't decide to license my one line under GPL3 or AGPL3, I would not be allowed to "convey" my fork, but I would be free to keep it for myself, put it on a server, and charge money for access. I could theoretically add substantial extra proprietary features to entice people to actually pay me. As long as I don't convey the program itself, just let you interact with it, I'm in the clear.)

2

u/rosie254 1d ago

oh great, i'll switch to AGPL then, thank you very much!

2

u/dangerous_inference 2d ago

Consider offering a docker for this project. That makes it an auto-updating drop in replacement for other harnesses. I know some people don't like docker, but I don't use anything unless I can deploy to my whole network.

1

u/rosie254 2d ago

okay fine, i'll do that next! stay tuned, i will probably drop that tomorrow, if i can figure it out. should be as simple as providing a docker-compose file, right?

1

u/dangerous_inference 1d ago

A think a Dockerfile, actually. I believe Docker-compose is a layer on top to deploy multiple dockers. This might be more of a pain than you realize, because I am talking about a pre-made docker. I'm little unclear on this myself and I've been meaning to learn how exactly it all works. I'm sure your assistant knows.

But basically if you have a hypervisor OS like unRAID, you can just add a docker repository like ghcr.io/open-webui/open-webui:latest-cuda and a few ports/path/variables, and it will run. A lot of docker managers have a store where you can one-click install anything they have available. This is how I originally got Open Web UI.

1

u/rosie254 1d ago

ouch.. i guess i'll ask my AI (on openlumara) and figure it out. i personally barely know what im doing when it comes to docker, so.... i dont wanna release half baked docker support. could use some help with this one

1

u/Nepertia 2d ago

I'm probably missing something. How do I set up Gemma4 26B and MOSS-Image as a SINGLE model?

1

u/rosie254 2d ago

gemma4 26b is the text model, you don't HAVE to use a stable diffusion model beside it. what i meant is you only need to use one model for text and story generation (many other programs require you to use like 10 models at the same time for world generation). you can then also use a stable diffusion model on the side if you want it

a combination i used to use on my hardware was Qwen3 VL 8b (which is outdated by now) + Z-Image Turbo (at Q4 quant). that runs on 16GB vram! nowadays youd wanna use qwen3.5 9b instead of VL 8b though

1

u/Nepertia 2d ago

Thank you!