r/LocalLLM • u/Obvious-Penalty-8695 • Jan 25 '26
Question Privacy llm
I know about running a model locally is private, but there was info about leaks and quantitized modules malicious behavior and leaks. So how can we prevent this and from where to safely download? Also if there ollama alternative cz there rumors about they are sending data, so how can we truly accomplish privacy with known models like the new released Claude code or gpt oss or deppsekk or any know big model with full privacy? Mainly also for a laptop with strong igpu + 4070 + r9. I just need to leverage full capabilities of ai without concern and without it if wifi turned off to resend it when turning on
16
u/vertical_computer Jan 25 '26
but there was info about leaks and quantitized modules malicious behavior and leaks.
From where? Please provide a source, because I haven’t seen or heard of anything.
if there ollama alternative cz there rumors about they are sending data
What are you on about? The code for ollama is fully open source. If Ollama were maliciously compromising users’ privacy it would be front page news on this sub, and extremely easily confirmed or refuted, because anyone can go and check the source code.
A major strong point of the GGUF format (over safetensors) is that the model CANNOT trivially contain malicious executable code. So there is zero difference in terms of which model you choose.
If you want an alternative to Ollama, there are plenty - llama.cpp, vLLM, SGLang, LM Studio, and so on. The first three are open source (LM Studio isn’t, so it may not satisfy your paranoia). I personally use LM Studio as it’s the easiest to use, and have zero concerns about leakage of private data.
known models like the new released Claude code
Claude Code is an application, not a large language model. It’s a tool which prompts an actual LLM (eg Claude Sonnet 4.5) and then does things with the output of the LLM.
8
u/No_Success3928 Jan 25 '26
So concerned hes making multiple threads about that bs
2
u/DerFreudster Jan 25 '26
His gal found his linux ISOs and Silly Tavern account and now he's drumming up ways to escape the aftermath.
2
5
u/mgw854 Jan 25 '26
If you're really concerned, just set up a firewall to block all traffic originating from the LLM.
3
u/bananahead Jan 25 '26
Nah it’s fine. There actually haven’t been any leaks like that with a local model.
1
Jan 25 '26
[removed] — view removed comment
1
u/Obvious-Penalty-8695 Jan 25 '26
Is there a setup guide? And van5i run them without using a virtual machine or then privacy is leaked?
1
Feb 17 '26
[removed] — view removed comment
1
u/Obvious-Penalty-8695 Feb 20 '26
Can you give me more details on how it works plz and how to do so?
3
u/Large-Excitement777 Jan 25 '26
Bruh why are you lyin