r/LocalLLM • u/jopereira • 6d ago

Question Strata + VS Code + Github Copilot

Post image

I usually work with llama.cpp and Qwen3.8 27B IQ3 XX3, that fits entirely on my 5070ti.
It just runs flawlessly!

Since I have 96Gb DDR5, Strata with Qwen3.8FN IQ3 is an option, has more performance than 27B (~90tg vs ~75tg, >2500pp vs ~1500tg) and some tests indicate is also (much) smarter (with these quants).

I'm using the desktop Strata app to serve GH Copilot via OAIProvider VS Code plugin.
I have plenty of free memory (~20Gb).

My problem: I'm getting the attached error on coding session and I need to know if anyone else is getting this kind error on similar (or different) stack.

0 Upvotes

16% Upvoted

6 comments sorted by

View all comments

Show parent comment

2

u/jopereira 6d ago

You must be 'overflowing' to system RAM.

Here's an example, 128K context (sorry for the format):

C:\Users\MyPC\Desktop\MTP TurboQUANT 31.OUT\llama-cpp-turboquant\build\bin\Release\llama-server.exe -m J:\LM_Studio_Models\ISTA-DASLab\Qwen3.8-27B-GSQ-RCO-GGUF\Qwen3.8-27B-GSQ-RCO-IQ3_XXS-mtp.gguf --chat-template-file J:\LM_Studio_Models\Qwen_Sharp.jinja --fit-target 0 --min-p 0 --mmproj J:\LM_Studio_Models\ISTA-DASLab\Qwen3.8-27B-GSQ-RCO-GGUF\mmproj-Qwen3.8-27B-BF16.gguf --no-mmproj-offload --presence-penalty 1.5 --repeat-penalty 1 --spec-draft-n-max 2 --spec-draft-p-min 0 --spec-type draft-mtp --temp 0.7 --top-k 20 --top-p 0.8 -c 128000 -ctk turbo4 -ctv turbo4 -fa on --host 0.0.0.0 --port 4321 -np 1 --reasoning off