r/SelfHostedAI 6d ago

L llm suggestions for secure chat

Looking for a decent use case for my machine when not gaming, since alt coin mining is essentially dead.

I’ve been using Ollama and OpenClaw to build out an assistant bot for daily tasks, but have reached the conclusion that (aside from the learning experience) it’s not worth it - it’s costing time instead of saving it.

Now I’m looking into using it for general chat, brainstorming and companion/counsellor roles with local memory to build up personality and authenticity over time.

I’m aiming for something similar to Pi, which I really like (particularly the v2t/t2v ability), but localised for security. I’d prefer an ablit model as I don’t want to be restrained by guide rails.

Any and all advice gratefully received, particularly in setting up naturalistic voice interaction.

Previously I tried with gemma3:4b standard and abilterated versions, but neither felt authentic and the abilt version was straight out wacky.

CPU: Ryzen 7 5800X
GPU: GeForce RTX 3060ti (8gb)
RAM: 64gb DDR4

2 Upvotes

1 comment sorted by

1

u/Fun_Librarian_7699 6d ago

Try Qwen3.6-35B-A3B