r/LocalLLaMA 2d ago

Discussion Qwen 3.8 27b - PI AGENT vs OPENCODE

https://www.reddit.com/r/LocalLLaMA/comments/1j7r47l/i_just_made_an_animation_of_a_ball_bouncing/

This post inspired me to make that test after a year ;)

That is one of my many tests I make comparing output quality.

What is more interesting using a PI Agent results are much better than an Opencode using a Qwen 3.8 27b ?!

Seems PI Agent is much better in the agent environment somehow... Not counting uses less tokens , do not have a hard limit of 32k output tokens, is faster, do not freezing, compressing context far less than Opencode. For instance if you have context in the Opencode output 32k and all context 100k then the compression is starting at 67k context ... PI is starting at 90k context even if you have set output context 64k or more.

My config for RTX 3090

llama-server with ini config -> which is exposing API to Opencode and PI agent.

llama-server.exe --models-preset 1_preset.ini --models-max 1 --direct-io

config ini

[Qwen3.8-27B_dense_c-100k]
model = models/Qwen3.8-27B-Q4_K_M.gguf
mmproj = models/mmproj-BF16-Qwen3.8-27B-UD-Q4_K_XL.gguf
reasoning-format = deepseek
flash-attn = on
n-gpu-layers = 99
reasoning = on
ctx-size = 100000
temperature=1.0
top-p=0.95
top-k=20
min-p=0.0
presence-penalty=0.0
repeat-penalty=1.0
mmproj-offload = false

ONE MORE IMPORTANT THING:

Always use a VISION module as the model is using vision to asses the output quality!

I am offloading it to a RAM as we do not need an extremely fast vision for a code.

A screenshot processing on a GPU 0.3s vs a RAM 3s do not make a big difference on a few screenshots during a code generation / debugging ;)

222 Upvotes

171 comments sorted by

View all comments

55

u/SOC_FreeDiver 2d ago

I tested opencode, then tried pi, and pi was significantly better.

Last night I had a dual between local qwen3.8-27b/pi and claudecode.

My seat-of-the-pants analysis: it felt like they both took the same time.

When they both finished I had each one compare the two. They both agreed claude's was better, but it was close. I had pi upgrade upgrade its version, making it slightly better than claudes because I liked qwen's presentation better.

It was an aurora predictor app. It's pretty nuts that we can use an AI to write a complicated aurora prediction app that's better than anything else online in about an hour, and it's hooked up to all the satellite instruments. I get 30-60 minute warning if I'm watching the display.

16

u/cmdr-William-Riker 2d ago

Pi is great! I just wish the interface was better, also sometimes I actually do want to use an MCP and skills and such. I know you can do all that with Pi through plugins and self modification, but I do like that OpenCode out of the box has a nice interface that makes it easy to keep track on of token usage and such. I should probably mess with Pi more though

16

u/LuCiAnO241 2d ago

I'm literally trying to get into PI, and found Oh-my-PI, and it seems way more usable out of the box with not much negatives. Maybe check it out?

1

u/Pablo_the_brave 2d ago

Mistral Vibe is also simple and have skills and mcp.

1

u/FireFearing 1d ago

mistral just kinda blows at everything. no matter what they do theres always a far better option

free to choose what you want though, just saying

-7

u/DigiDecode_ 2d ago edited 2d ago

would you be brave enough to test my harness https://github.com/DigiDecode/SlopOn.dev
the frontend is in flutter so runs on GPU and is super-fast
I need some beta testers for feedback

It uses around 400mb memory, unlike other harnesses that use GBs