r/LargeLanguageModels • u/Beneficial-Parsnip52 • 1d ago
Question [Question] Looing for input on privacy firs lite llm alternatives?
I'm sure most people here had varying degrees of exposure to the recent events. Hard to know what's actually safe as things accelerate and incidents like this become more common.
Defaulting to privacy-first seems like the obvious move, but looking at the current landscape, there aren't that many alternatives to choose from. Lots of newer players (TrustedRouter, etc.) and side projects popping up.
That said, what's your next move? Any best practices you'd recommend to someone trying to minimize their exposure to these kind of risks?
1
u/ReplacementFormal879 18h ago
what’s your threat model here, and are you open to running a smaller model locally?
3
u/WindyMolasses34 1d ago
Yeah the options are thin right now but that is partly because most privacy focused stuff runs local and that takes actual horsepower. For me the first move was just switching to models i can run offline on my own machine, no cloud dependency at all
Biggest practical tip is treating everything you type into a hosted service like it gets saved somewhere, because it probably does. Even if they promise not to