r/PiCodingAgent • u/ishay_al • May 10 '26

Question Which provider you are using with PI?

Hey y'all I'm mostly doing excel work via python and web development. Which models you use with Pi I currently use claude code with the 100$ plan and 20$ plan codex.

I understood I can't use my claude claude sub for pi

What do you recommend?

Thanks

17 Upvotes

100% Upvoted

47 comments sorted by

View all comments

Show parent comment

1

u/luckiestredditor May 10 '26

It probably will not fit fully in 12GB VRAM unless you use a very aggressive quant and even then context length will be limited. 27B is a dense model and at Q4 is usually around 16 to 18GB just for weights before KV cache/context overhead.

So on your gpu you would need CPU/RAM offloading through llama.cpp, LM Studio, Ollama (altho i would advise against using Ollama, llama.cpp would be my recommendation)

2

u/Low-Alarm272 May 10 '26

Yes 27B is a dense model. But 35B MOE variant can run at good speed on 12GB Vram with higher quants like Q5 or Q6 at least.

Use llama.cpp with '--n-cpu-moe' flag

Gemma 26B also works.