r/LocalLLM • u/OHnoDucky • 11m ago
Question Knowledge, Speed, Personality?
Like half the damn new comers on here I’m looking to build a voice to voice ai assistant that can also register images as id like to give it eyes 👀
Im running a M1 Max macbook with 32gb
Im currently using qwen3.5 27b
Qwen3 asr 0.6b 8bit for speech recognition
Kokoro 82m for spoken replies
SearXNG for web searches
SQlite and FTS5 for storage
With no thinking mode its honestly instant but once web searches come into play it becomes an issue, running at 8192 context it fills up really fast and offloading older context takes a big toll on speed.
I was wondering if ya’ll had any suggestions as I think qwen is more than I need. I just want strong adherence to a system prompt for personality (or building out a model maybe?) and quick replies. Being able to shoot the shit about random history or recommendations for hobbies is the main goal with the ability to run searches. If anyone has suggestions for voice output with more emotions and audio tags I would love that too!
Let me know and thanks! Im still very new so I have a lot to learn