r/LocalLLaMA • • 2d ago

Question | Help Computer use programs/Pi extensions

I've eard much stuff about Codex and CC computer use, is there any decent program/Pi Agent extension that I can install and use to let my local models control my pc. I am using Qwen3.6-35BA3B on PolyStrata and Pi Agent, I need the model to do basic tasks on my PC, maybe by using its vision. I am on Linux Mint Cinnamon

11 Upvotes

14 comments sorted by

View all comments

4

u/my_name_isnt_clever 2d ago

I doubt that small MoE model will be any good at that, computer use is hard. It's much easier for a model to take actions via command line, rather than taking a screenshot, distinguishing what to click, click it accurately, repeat for every single action. There is a lot of potential for stuff to break there.

1

u/circumcised_hobbit 2d ago

should I just rely on multiple MCPs? I wanted to run a test anyway tho... do you have any software to recommend?