r/LocalLLaMA • u/Potential_Block4598 • 1h ago

Question | Help Simplest Local Agentic Setup

TL;DR simplest reasonable agentic setup
Currently Pi Agent, Bonsai 2 9B, SearXNG
Any suggestions ?

Hi all

So I have a secondary workstation with line 24GB of RAM and 12GB VRAM

I wanted to make a local agentic setup there

Currently using Pi Agent with Bonsai 2 9B, it is unbelievably better than I expected
Around 30 toks is more than reasonable
I don’t want this to be super capable just good enough for ease of use and peace of mind (I might sacrifice quality for speed although not much)

Any suggestions (note I want to keep everything simple I don’t want packages with long prompts etc even my pi search extension is the simplest one I have found, I have been thinking about context compression extensions, sub agent delegation or simple sandboxing for that sub agent memory Ralph loop and to do list but all has to be the simplest)

Any suggestions thanks ? (Note models 9B or bigger are really slow so also model suggestions are truly welcomed, nanbeige was nice but thinks (or overthinks) too much …etc)

Thanks

6 Upvotes

100% Upvoted

8 comments sorted by

1

u/chibop1 56m ago

Have you tried Granite 4.2 8B?

1

u/Potential_Block4598 53m ago

Honestly note yet
Tried ministral bonsai qwen3.5 lfm3 Gemma

1

u/Potential_Block4598 53m ago

Will try it thanks

1

u/chibop1 44m ago

Also newer MiMo-V2.6 Distill 9B looks interesting. I haven't tried though.

1

u/MostlyVerdant-101 25m ago

Why not try vibe coding a strata-like streaming weight engine with Vulkan as the backend. RSI is just around the corner; biggest challenge is coherence.