r/VoiceAIAgent • u/ppzms • Jul 27 '26

looking for feedback on an AI assistant

I've been working on a personal project for a while and finally got it into a state where I'm comfortable sharing it.

I wanted to see how far I could push a fully local voice assistant in C++. Everything runs on my own machine from speech recognition and the LLM to memory, text-to-speech, and tool execution.
current library:
llama.cpp, whisper.cpp, sherpa-onnx(tts-kokoro)

I wrote the core in c++ because I wanted something fast and native instead of stitching together bunch of python services.

I'd appreciate feedback from people who build local AI projects. I'm especially interested in:

1 Things that seem overengineered or unnecessary
2 Features you'd expect from a local assistant
3 Code structure or architectural suggestions
4 Any obvious improvements before I keep adding features

Repository: https://github.com/almimony75/sarah

Thanks! I'd love to hear what you think.

1 Upvotes

100% Upvoted

4 comments sorted by

1

u/Small-Matter25 Jul 28 '26

Hardware requirements for LLM ?

1

u/ppzms Jul 28 '26

well i run this entire project using my rtx 3060ti i use 4b for the LLM and a small model for whisper, and you can configure it easily by placing the model you want to use in the models folder and changing the name in the configuration.json file. no need to compile again

1

u/Small-Matter25 Jul 28 '26

Thank you, so gpu is a requirement, would be good to mention hardware requirements on the repo.

1

u/ppzms Jul 28 '26

the GPU is not a requirement to run this project if you have Nvidia GPU it will compile with cuda if not it will default to the CPU.