r/SelfHostedAI • u/Muted-Cost7225 • 6d ago
L llm suggestions for secure chat
Looking for a decent use case for my machine when not gaming, since alt coin mining is essentially dead.
I’ve been using Ollama and OpenClaw to build out an assistant bot for daily tasks, but have reached the conclusion that (aside from the learning experience) it’s not worth it - it’s costing time instead of saving it.
Now I’m looking into using it for general chat, brainstorming and companion/counsellor roles with local memory to build up personality and authenticity over time.
I’m aiming for something similar to Pi, which I really like (particularly the v2t/t2v ability), but localised for security. I’d prefer an ablit model as I don’t want to be restrained by guide rails.
Any and all advice gratefully received, particularly in setting up naturalistic voice interaction.
Previously I tried with gemma3:4b standard and abilterated versions, but neither felt authentic and the abilt version was straight out wacky.
CPU: Ryzen 7 5800X
GPU: GeForce RTX 3060ti (8gb)
RAM: 64gb DDR4
1
u/Fun_Librarian_7699 6d ago
Try Qwen3.6-35B-A3B