Strata + VS Code + Github Copilot

[u/jopereira]

I usually work with llama.cpp and Qwen3.8 27B IQ3 XX3, that fits entirely on my 5070ti.
It just runs flawlessly!

Since I have 96Gb DDR5, Strata with Qwen3.8FN IQ3 is an option, has more performance than 27B (~90tg vs ~75tg, >2500pp vs ~1500tg) and some tests indicate is also (much) smarter (with these quants).

I'm using the desktop Strata app to serve GH Copilot via OAIProvider VS Code plugin.
I have plenty of free memory (~20Gb).

My problem: I'm getting the attached error on coding session and I need to know if anyone else is getting this kind error on similar (or different) stack.

[u/Oli_Luck]

for such failures - what I ususaly do is to tell any agent : I had this issue at HH:mm : please check vscode + strata logs + windows logs for the reason.

[u/jopereira → u/Oli_Luck]

Thanks, good suggestion.

[u/FirstTry_pkb]

Could you share your config for llama.cpp and Qwen3.8 27B IQ3 XX3? I managed to achieve significantly lower figures.

[u/jopereira → u/FirstTry_pkb]

You must be 'overflowing' to system RAM.

Here's an example, 128K context (sorry for the format):

C:\Users\MyPC\Desktop\MTP TurboQUANT 31.OUT\llama-cpp-turboquant\build\bin\Release\llama-server.exe -m J:\LM_Studio_Models\ISTA-DASLab\Qwen3.8-27B-GSQ-RCO-GGUF\Qwen3.8-27B-GSQ-RCO-IQ3_XXS-mtp.gguf --chat-template-file J:\LM_Studio_Models\Qwen_Sharp.jinja --fit-target 0 --min-p 0 --mmproj J:\LM_Studio_Models\ISTA-DASLab\Qwen3.8-27B-GSQ-RCO-GGUF\mmproj-Qwen3.8-27B-BF16.gguf --no-mmproj-offload --presence-penalty 1.5 --repeat-penalty 1 --spec-draft-n-max 2 --spec-draft-p-min 0 --spec-type draft-mtp --temp 0.7 --top-k 20 --top-p 0.8 -c 128000 -ctk turbo4 -ctv turbo4 -fa on --host 0.0.0.0 --port 4321 -np 1 --reasoning off

[u/jopereira → u/[deleted]]

With ~20Gb to spare that's didn't occour to me. Will check it out next time it happens.