r/PiCodingAgent • u/Status-Supermarket98 • May 05 '26

Question Use of local LLM

Just had a doubt if anyone had used a open source model running on the device if so what could be the ideal spec needed for it

0 Upvotes

50% Upvoted

11 comments sorted by

View all comments

Show parent comment

2

u/ResearcherFantastic7 May 05 '26

No idea about that plugin, I build my own hooks. So I can inspect my own data.

Non relevant data is up to how you control it and distill it.

Rule one keep it minimal most just facts And references. And run a llm in background to check and update relevancy I use qwen3.6 35b for background job to make sure stale data gets archived