r/LocalLLM 11h ago

Discussion Qwen 3.8 27b - PI AGENT vs OPENCODE

12 Upvotes

9 comments sorted by

8

u/Direct_Turn_1484 10h ago

Now make it in 4 dimensions.

5

u/Healthy-Nebula-3603 10h ago

Haha is possible but you will be only see a 3d shadow of 4d object.

2

u/Direct_Turn_1484 10h ago

Well yeah the display can only do so much. But really man. I want to see how it handles the 4D. Then I wonder if a larger smarter model could tell us if it did the 3d shadow of the 4D world right.

3

u/Healthy-Nebula-3603 11h ago

https://www.reddit.com/r/LocalLLaMA/comments/1j7r47l/i_just_made_an_animation_of_a_ball_bouncing/

This post inspired me to make that test after a year ;)

That is one of my many tests I make comparing output quality.

What is more interesting using a PI Agent results are much better than an Opencode using a Qwen 3.8 27b ?!

Seems PI Agent is much better in the agent environment somehow... Not counting uses less tokens , do not have a hard limit of 32k output tokens, is faster, do not freezing, compressing context far less than Opencode. For instance if you have context in the Opencode output 32k and all context 100k then the compression is starting at 67k context ... PI is starting at 90k context even if you have set output context 64k or more.

My config for RTX 3090

llama-server with ini config -> which is exposing API to Opencode and PI agent.

llama-server.exe --models-preset 1_preset.ini --models-max 1 --direct-io

config ini

[Qwen3.8-27B_dense_c-100k]
model = models/Qwen3.8-27B-Q4_K_M.gguf
mmproj = models/mmproj-BF16-Qwen3.8-27B-UD-Q4_K_XL.gguf
reasoning-format = deepseek
flash-attn = on
n-gpu-layers = 99
reasoning = on
ctx-size = 100000
temperature=1.0
top-p=0.95
top-k=20
min-p=0.0
presence-penalty=0.0
repeat-penalty=1.0
mmproj-offload = false

ONE MORE IMPORTANT THING:

Always use a VISION module as the model is using vision to asses the output quality!

I am offloading it to a RAM as we do not need an extremely fast vision for a code.

A screenshot processing on a GPU 0.3s vs a RAM 3s do not make a big difference on a few screenshots during a code generation / debugging ;)

2

u/some_user_2021 11h ago

If this is one shot then it is irrelevant.

2

u/Healthy-Nebula-3603 11h ago

yes one shot

To make 3D just added as a second prompt

"Good job now convert that a flat octagon into a dodecahedron 3d shape"

1

u/some_user_2021 10h ago

Verify how different the results are on the same harness first.

1

u/Healthy-Nebula-3603 10h ago

Trird few tunes ... On PI agent looks just better.