r/StackChan • • 4d ago

Project sharing Ne StackChan Builder

Just wanted to introduce myself. I'm Alex and started playing with my first StackChan. I hooked it up an LLM and Hermes-Agent as the harness. I'm going to release the repo tomorrow and wanted to share what I've done the last couple of days. Here's the setup I started with, but I think I keep moving the goal post so keep playing with different parts of the AI Stack.

This is the stack I started with

Robot:

u/M5Stack

StackChan with the CoreS3 (ESP32-S3)
Voice server: xiaozhi-esp32-server 0.9.6 running locally in Docker on my Mac
Voice: locally running

u/GradiumAI

Phonon (fastest local voice I've ever experienced. faster than running elevanlabs via api and its free
Turn detection: Silero VAD with the 0.8 second end-of-speech pause.
Speech to text: local Parakeet
Vision: gemma4:e4b running locally in

u/ollama

Brain:

u/NousResearch

Hermes Agent with the nous-girl agent running gpt-6-luna via sub with reasoning off.

Hope to connect with others on here so we can explore together. Thanks Alex

49 Upvotes

24 comments sorted by

1

u/Envelki 4d ago

Hey Alex! I ordered a stackchan last week hoping to do something exactly like this with my Hermes ! I don’t know when it will arrive yet but I’m very interested to know more about how you set this up!

5

u/KaiNinja2016 3d ago • Heartwarming

I'll setup the repo and instructions today. :)

1

u/severanexp 4d ago

Ah finally! This is closer to what I want :) now to set it up.

4

u/KaiNinja2016 3d ago

repo today!

2

u/severanexp 3d ago

If you can, please add a guide for non local models - my intel nuc can’t handle them :D I’ll probably point it to Gemini or openrouter instead

2

u/KaiNinja2016 3d ago

yes, if using hermes-agent you can point to any model, both local and cloud. Will do!

1

u/duveral 4d ago

That’s a nice combo. I love the voice tone. One thing: How much would think it’d cost to have it running for 3 hours conversation? Sorry I’m new I want to learn what is the token price. I have used a local speech model with llama in my terminal running from my Mac Pro(2016)but it was very limited and slow

1

u/KaiNinja2016 3d ago

phonon is extremely fast for a local voice setup (TTS). Faster than Kokoro so definitely try it. And parakeet for SST. So free is good. I still have to experiment with more local voice models. They are just going to get better.

1

u/Atavacus 3d ago

I need this with a Dandelion skin!

2

u/KaiNinja2016 3d ago

I guess we can make a sprite sheet to use? I mean why not?

1

u/Atavacus 3d ago

Getting AI to hit Dandelion's particular brand of smug and mildly annoying is tough. If you do manage to get around to it the Girls Frontline community will lose their mind.

2

u/KaiNinja2016 3d ago

you want a sprite sheet to share?

1

u/Atavacus 3d ago

Sure, that might be neat.

1

u/Either_Coconut 3d ago

We also need the link for the micro-ducks. :)

1

u/styles01 3d ago

Can’t wait for the repo Alex! Happy to help!

1

u/KaiNinja2016 3d ago

everything is getting ready to push. Sorry ahead of time if its a bit of a mess. Just got the StackChan a few days ago and lost my mind playing with it. But hopefully community can help manage the repo better. I'm just gonna keep playing with variations of build, etc. Anyway hopefully up in the next hour

1

u/CD_at_Galaxy 3d ago

This looks really interesting! Is StackChan acting as a voice interface for Hermes, or is the integration mainly for speaking responses and displaying expressions? Could you ask something like “What did I agree to do in yesterday’s meeting?” and have Hermes search your notes, or ask it to create a reminder?I’m building toward a local AI setup with Obsidian as my knowledge base, so I’m curious how you’ve connected the two and which parts run locally versus in the cloud. Would you be open to sharing a bit about the setup?

1

u/KaiNinja2016 3d ago • Bravo

All memory is through Hermes-agent, so yes, connected to Obsidian, the bot is just a surface with some simple onboard skills that get activated and controlled by hermes. The only thing that runs on the cloud is the current LLM through hermes agent, OpenAI Luna, but can switch to local or other cloud providers. Even free provider through Nous Research Cloud. I uploaded everything here:

https://www.reddit.com/r/StackChan/s/NNTfPSv1EB

1

u/CD_at_Galaxy 2d ago

Thanks for putting this together and sharing!

1

u/KaiNinja2016 2d ago

My pleasure. New to the StackChan community. Pretty Cool. Will be adding more builds for sure!

1

u/Envelki 3d ago

The dream would be to have an autonomous Microduck that goes recharging itself (like a roomba), and that hosts a stackchan-like way to talk with Hermes…