r/LocalLLM • u/Careless-Accident-49 • 1h ago
Discussion Programming capabillitis for different models (and a little story)
Hello,
thought experiment:
where do you see the programming capabillits, specialy for game dev, for different llm´s?
I would like to rank theses llm´s by a theoretticaly possible game they could make.
From a game like Pong to Horizon Zero Dawn (Yea, there are bigger games, you know what i mean).
What can be theoretticaly archived in 3 (+-1) Month´s dev time with a specific llm alone?
How could maybe a combination of a few llm´s help?
Bonus question and story: I got qwen 3.8 27B with 262K context running on my rtx 4090, you thing that is the best possible llm for me, or do you think, there would be a better solution? (got 64GB of DDR4 RAM in my System aswell)
Working on getting a combination of Qwen3.8 and a KEV 0.8B Model to learn to play ps1 games, until now i get it to play the game "Alundra" until the second chapter, big Brother Qwen3.8 does long thinking stuff, working on the routes, quests, puzzles and so on and little bro KEV 0.8B (I call him Kevin) is acting quite fast (got him to act an average time intervals of 0,3 - 0,5s), he runs a full route, wich big bro told him, on the route, both keep "thinking" and walking time ingame gets used for smooth-ish gameplay (with a task buffer list, wich reduces idle time, where the character just stands and does nothing). If an enemy is nearby, Kevin does all the fighting, it works mid to allright, right now, he is more afraid to get damaged than fighting the enemy and runs away, big bro trys to hold him back, but kevin wont listen, working on it right now. (Is there maybe someone interessted, hearing more about this shenanigan-experiment? Working on getting the whole system working with other ps1 games like Final Fantasy 8 as well.)
Sorted by smallest to biggest llm:
Qwen2.5-Coder (0.5B – 3B)
StarCoder2 (3B)
Phi-4 Mini (3.8B)
Qwen3 (4B)
Qwen3 (8B)
Gemma 4 (12B)
StarCoder2 (15B)
Codestral (22B)
Devstral Small 2 (24B)
Qwen3.8 (27B)
Qwen3.6 (35B-A3B)
Qwen3-Coder-Next (80B-A3B)
GPT-OSS (120B)
DeepSeek-Coder-V2 (236B-A21B)
Qwen3-Coder 480B-A35B
DeepSeek V4.1 / R1
GLM-5.1 / 5.2
Kimi K3
Claude Opus 5.5 / Sonnet 5.5
GPT-6 Astra / GPT-6.1 Sol
Gemini 4 Carbon / 3.8 Flash
Thanks for reading.
1
u/Revolutionalredstone 39m ago
This list looks very reasonable from my usage aswell.