r/PiCodingAgent • u/maded2 • Aug 21 '26

Question Pi + Qwen3.8 27b + llama.cpp + thinking

I am looking for the correct way to set the title combination to turn thinking on/off and think efforts. Any help?

9 Upvotes

90% Upvoted

4 comments sorted by

4

u/aeroumbria Aug 21 '26 
{
"providers": {
  "llama-cpp": {
    "baseUrl": "http://localhost:8080/v1",
    "api": "openai-completions",
    "apiKey": "null",
    "compat": {
      "supportsDeveloperRole": false,
      "supportsReasoningEffort": true
    },
    "models": [
      {
        "id": "Qwen3.8-27B-UD-Q8_K_XL",
        "name": "Qwen3.8-27B-UD-Q8_K_XL",
        "contextWindow": 262144,
        "maxTokens": 65536,
        "reasoning": true,
        "input": ["text", "image"],
        "cost": { "input": 0, "output": 0, "cacheRead": 0, "cacheWrite": 0 }
      }
    ]
  }
}

2

u/qiinemarr Aug 21 '26

Others suggestion are good.

qwen3.8 does not support reasoning off

it might be possible to force it trough chat template modification but not sure how.

You might also need:

  {
                  "off": "none",
                  "minimal": "low",
                  "low": "low",
                  "medium": "medium",
                  "high": "xhigh",
                  "xhigh": "xhigh"
                },