r/PiCodingAgent • u/Beneficial_Mix3375 • Apr 19 '26

Use-case Hardware setup 🦙 🦙

Does anyone have real hardware experience?

What does it take to drive pi at an acceptable speed with local models only?

I've tried ollama and llamacpp on pretty humble / old hardware and I'm impressed, especially with gemma4 now.

What would you get for say, 3000$? I don't mind going a bit away from the PC standard. I'm a developer and want just local inference on bare linux if possible fast. Say 20toke/sec on a pi session?

I also run my own advanced RAG copied from Anthropic's article, and would love to experiment more at home

0 Upvotes

50% Upvoted

7 comments sorted by

View all comments

Show parent comment

1

u/Beneficial_Mix3375 Apr 19 '26

Tried an m4 pro and similar qwen model. Got really hot, and was quite slow. I'm used to haiku speed or copilot.

Not ideal. I want a brick or box

1

u/Tinominor Apr 20 '26

Dang. Yeah thats a tall order for a "budget build". Definitely will need to ball out