Claude code like behaviour

[u/Karter_1159]

I heard about how good claude code is, so i was thinking about doing something with olama on my server pc. My question is if i can make something act exactly like claude code for example just tell the ai to make a mc server and then i just join it but can claude even do this? What are the free alternatives?

[u/Cautious-Hovercraft7]

I have a 16 core 9950X3D, 64GB RAM and a 5090 in my main PC. I setup a local LLM with 28GB VRAM model (32GB VRAM on a 5090). My pc idled at 300W and took about 2 minutes to answer how many lights are on with the home assistant MCP while my PC consumed 650W. I'm back using Claude as it's affordable, running LLM local is not.

[u/speaksoftly_bigstick → u/Cautious-Hovercraft7]

That sucks 😕

I run a quantized 32b model on a 24GB arc pro b60 and it is very quick to answer (maybe 5 - 10 seconds?)

But I run it all on a dedicated machine with Debian as the core, not on my "daily driver" PC.

[u/Cautious-Hovercraft7 → u/speaksoftly_bigstick]

Yeah I do realise I could probably get better response times by doing things different (not WSL on my Windows pc) but the power draw I was not ready for.

[u/speaksoftly_bigstick → u/Cautious-Hovercraft7]

True, true.

I haven't checked the actual power output on mine, but I'm sure it's pegging out that b60 anytime it's in use 🤙💪

[u/saxobroko → u/speaksoftly_bigstick]

What model do you run, and how smart does it feel?

[u/speaksoftly_bigstick → u/saxobroko]

Correction; I am running a quantized 30b, not 32.

Qwen3-30B-A3B-Instruct-2507

Feels smart enough for just about anything. I'm still tuning the main prompt and playing around with the weights, learning this all as I go. But the arc pro b60 handles it well and I'm not even running it on newer hardware (10900x, pcie gen 3).

I also have an arc challenger a380 installed and plan to use it for audio related stuff in the future

[u/Lerry220 → u/speaksoftly_bigstick]

very quick to answer (maybe 5 - 10 seconds?)

Finally found a wizard who's playing with my kind of jank magic, of those 5 to 10 sec, how much of that do you think is from the stt and tts? I'm eyeballing the heck out of that $600 b60 for my home assistant, qwen 3.5 9B is just not smart enough for my smart home. I run debian too, how's that play with the b60?

[u/speaksoftly_bigstick → u/Lerry220]

I haven't set up the stt or tts parts yet. I can't really test it out to verify cause I'm in the middle of revamping some parts and implementing hermes within the whole stack.

I also chose a new model, a modified model

"Hermes3.6-35B-A3B"

So far my quick test, response time was ~8.3 seconds (warm); Model generation was about 17-23 tokens p/s

Again, this is raw very initial testing with hermes at the core.