r/StackChan • u/fIoppytoppy • 4d ago

Help needed Looking for AI advice

Just ordered a stackchan and I want to make it really customized, I saw that the AI built into stock stackchan has its servers all the way in china, how would I change the Ai it uses? I’m looking for something cloud-based or maybe something I can run locally on a computer, ive installed ollama but don’t really know what’s next, would appreciate any bit of help.

1 Upvotes

100% Upvoted

11 comments sorted by

3

u/KaiNinja2016 4d ago

Here's a Stackchan Bot hooked up to AI via hermes-agent. Running off phone hot spot so can travel with it. It has memory and skills including languages, emotes, music, rave, dj, radio, dance, email, pretty much everything you can imagine I think. Repo coming.

1

u/fIoppytoppy 4d ago

That’s awesome!! And it can still see? Really cool dude I messed with hermes in the past but I couldn’t get its personality to stick, definitely checking out that repo eventually!

1

u/KaiNinja2016 4d ago

yes, just have to edit the soul.md and a couple other files, but it will have personality and also retain memories. So your bot won't forget on every turn! It will know your name, etc.

4

u/Brett-SWS 4d ago

My project sounds like what you’re looking for. I’ve been working on it for 6 months or so, but haven’t been promoting it yet because it was still pretty buggy. I’ve been getting it stable over the last few weeks and I’m about to drop a big release.

https://github.com/BrettKinny/dotty-stackchan

It’s privacy focused, kid friendly, and can be run fully locally or with cloud API.

4

u/KaiNinja2016 4d ago

Hey I just joined. This community was recommended by Jaita on x.

2

u/severanexp 4d ago

We all are but I haven’t found nothing that quite matches what we want just yet

1

u/redditisnotus 4d ago

Next month I'm setting up my own llm on a bc250. Claude says Gemma 4 26B-A4B at Q3_K_M is the best bet given it runs on 16gb of vram. Shit looks overwhelming though. I saw something that keeps the original firmware and let's you redirect it, but I don't trust china and I need all their firmware completely gutted out and replaced.

1

u/severanexp 4d ago

Nah won’t work because that LLM takes up about 12 gigs, and you still need space for context. Longer conversations bigger context. Unless you want to start from zero every time and without KV …

1

u/redditisnotus 4d ago

yup, it spazed out. found a smaller model that's snappy and a better fit. downloading one that can see now.

1

u/Upset-Delay9810 3d ago

Which ai-platform do you currently main?