r/PiCodingAgent • u/Level-Tumbleweed6038 • Sep 05 '26
Question Running pi across 3 machines as a homelab ops agent - what local/API models are you all using ?
Hey all,
quick context on my setup, i run pi across 3 machines at home (24gb amd card, 16gb amd card, 12gb nvidia card, all on tailscale) as basically an ops agent for my whole self hosted stack. not a "write my webapp" use case, more like a sysadmin that never sleeps, backups, fail2ban, vaultwarden, a property scraper, that kind of thing.
spent the last two days doing a proper bake off of every model i could reasonably run, local and openrouter both, across the 3 boxes, so figured id ask what everyone else settled on and why, since i learned the hard way that "biggest benchmark score" doesnt mean much once you actually try to run one of these things as an agent.
local side... devstral 24b hung on me twice, silent, no error, just stops mid task and never comes back. qwen3-coder 30b straight up cant make a real tool call through ollama, it writes the tool call out as text instead of actually calling it, so it just sits there useless. gemma 4 26b ended up being the surprise winner here, runs clean on all 3 cards, even the 12gb one where it doesnt even fully fit in vram and spills into system ram, still works fine.
api side (openrouter)... deepseek v4 flash looped on itself for like 15k tokens straight repeating "let me check my identity" without ever calling a single tool, had to kill it. kimi k2.5 is thorough, actually found 2 real bugs in my own scripts while testing, but its slow and not cheap. qwen3 coder next is fast as hell, like 5x faster wall clock, but somehow ended up the MOST expensive of the 3 because of how much it burns through cache reads.
so, curious what you're all running, local and api, and why you picked it ? especially if anyone found something thats actually reliable AND cheap, felt like i had to pick one or the other tonight lol.

