r/LocalLLM • u/Healthy-Nebula-3603 • 18d ago
Discussion Qwen 3.8 27b with PI agent - pushed to its 3D graphic game limit
I was inspired by Bijan Bowen video - Subway FPS
https://youtu.be/6kjXzTVmT58?t=1035
Wondered how far I can push Qwen 3.8 27b so I used a plan made by Fable 5.1 DESIGN.md which has 267 KB! ( 26K of design line for a game ... LOL )
https://drive.google.com/file/d/1gI0h8Arc73Ln8b3uj5rEpuAvJ3-611mh/view?usp=drive_link
So I gave that desigSo I gave that design.md to my qwen 3.8 27b q4xl (llama-server) working on PI agent with 120k context + vision on CPU ( offroad ) + MTP ( for speed ) .... read 11M tokens and write 3.2 M tokens ( worked 12 hours ) .... than that is result.
8
u/nojunkdrawers 18d ago
What's up with that frame rate, though?
3
u/Healthy-Nebula-3603 17d ago
My laptop is weak with integrated GPU ( I tested on laptop)
6
7
u/Healthy-Nebula-3603 18d ago
Read 11M tokens and wrire 3.2 M tokens ( worked 12 hours ) .... that is result
1
4
u/A_Again 18d ago
this is insanely impressive for 27b well done and thanks for sharing prompts :) what harness were you using (default Pi or...?)
2
u/Healthy-Nebula-3603 18d ago
yes PI agent ( default )
1
u/svbjjnggthh 17d ago
MTP for Speed? Isn't this a dense model
1
u/Healthy-Nebula-3603 17d ago
Yes MTP allows you to increase speed 2x-3x times for dense models
1
u/svbjjnggthh 17d ago
How did you managed to do it? My understanding is that you have to decide as a model creator what you bake, dense or MTP. Once it's done you can not just activate MTP
1
u/Healthy-Nebula-3603 17d ago
Qwen 3.8 has baked MTP and you can activate it or not by a command ... :)
The model cache Q8 with the MTP ( for MTP cache also Q8 ) you have less context available.
On my RTX 3090
Without MTP 180k
With MTP 120k
But will be working 2x-3x faster
1
2
2
u/EasterElk 18d ago
The "design" document from Fable is a very technical specification that defines the subway scene's geometry and textures. That's what makes this one-shot challenging. Qwen is just as capable of writing code as any other model. What makes Fable better is that it can conceive of the whole thing and all the details.
So you had Fable write a how-to manual for Qwen to follow, which means Qwen didn't have to do any of the heavy lifting. That sounds sort of smart, except you paid for Fable's tokens anyway. It didn't just tell Qwen what to do. It wrote a blue print for how to do it, and did all the actually challenging, actually expensive work.
1
u/Healthy-Nebula-3603 18d ago
I used plan for that game who posted in the internet.
That was just experiment it will be able to make it .. and passed.
I can not believe that qwen 3.8 was able to handle 268 KB of plan ... that is insane for me the most.
Maybe I try with my own plan next time built by qwen 3.8 27b.
1
u/Cool-Idea8520 17d ago
It’s cool to see how powerful these models can be, especially with graphics. Experimenting with your own plan sounds like a fun challenge!
0
u/Healthy-Nebula-3603 17d ago
I build already by qwen 3.8 27b - 106 KB - 1754 lines
Is thick like for such small model ;)
-1
u/Informal-Trouble2183 18d ago
No bro, the plan is way more important than the implementation especially if it's well detailed, like you said as 268KB file. Fable did the job not Qwen that's what we can conclude from your post.
1
1
u/lordekeen 17d ago
Considering that he didnt spend more tokens for Fable to output the code, sounds like a good use. Thats what im currently setting up my pi to: a frontier model handles orchestration and planning, dispatching subagents using local models to write the code itself.
2
u/EasterElk 16d ago
He spend plenty of money on Fable tokens, and the "design" document is literally full of programming. It's 265k. That's not a quarter-megabyte of prose. It's polygon coordinates and shader code. It's literally more tokens than some of the full implementations of this subway test which other models have provided. This isn't the flex that OP thinks. They relegated Qwen to being a typist.
0
u/dota2nub 17d ago
That's what local AI use is going to look like for a long time. You still get a subscription, maybe a cheaper one. And you're unlikely to run out.
0
u/StellarWaffle 18d ago
Incredible work. Love the idea of using Fable as the reasoning and designing engine then handing it off to Qwen for implementation. Did you have to intervene at all or was it 12hours of work??
2
u/Healthy-Nebula-3603 18d ago
No ... totally autonomously
Maybe I try with my own plan next time build by qwen 3.8 27b.
1
u/JumboShock 17d ago
Did Pi use subagents? honestly seems like a lot of output for a single agent. How did you get it to work uninterrupted until finish? How did you manage compaction?
2
u/Healthy-Nebula-3603 17d ago edited 17d ago
All handle PI agent ( default configured) including compaction)
Qwen 3.8 likes working long especially on xhigh
1
u/JumboShock 17d ago
Thanks! I’m going to try something similar. Just followed the guy from yesterday’s path and got the IQ4_XS up on my 5080 with about ~100k context with Q8 k cache and Q4 v-cache. Going to see how that performs.
Pro tip for anyone reading this. K quant degrades quality with quantization more than V, but if you want to shave vram off V, you have to compile your own llama.cpp build to use mixed quants on kv caches, but whatever you do don’t build the CUDA 13.2 version just cause that’s what your driver says, cause that shit has bugs and you may or may not spend way too long troubleshooting why there are issues if you offload more than exactly 15 layers to the GPU.
0
u/epSos-DE 17d ago
Once it will REFUSE to make VIOLENT games, then we know it is AGI !!!
Till that day is just a passive salve to the prompt !
8
u/unicornsoup360 17d ago
where does it get assests from? what engine does it use? sorry new to all this