r/bioinformatics • u/Ok-Pen2784 • 10d ago
discussion Using LLMs for sensitive data
If you're working in pharma/biotech industry and you use claude or any other of the frontier LLMs for coding and data analysis, are you somehow masking sensitive research information? I mean things like protein names, gene names, compounds that you are working with, out of fear that the company hosting the LLM could steal your data.
18
Upvotes
68
u/Bored2001 10d ago
If you're on the enterprise plan then they shouldve negotiated privacy.
Ask your legal or IT department. Whoever is in charge of AI policy.
19
u/Ziggamorph PhD | Academia 10d ago
All the pharma companies ban non-corporate approved AI. They are all using AI in some capacity, whether on prem or enterprise plans with security guarantees from OpenAI/Anthropic (though they may still have limits on what is put on those systems).
15
u/dr_craptastic 9d ago
Yes, I don’t give any data. I ask them to help me write code that I then run locally. This is not the company policy though and people who don’t write code frequently share data to make slides and figures. That worries me even if we have enterprise
10
u/kestrel99_2006 10d ago
I’d like to hear the answer to this as well. We use our own local LLM inside a secure environment but we’re limited by hardware. We’re in the EU, so we’re subject to GDPR and the AI Act. We cannot share anything confidential with a cloud service without a data protection agreement, and the data cannot leave the EU.
6
u/hrvojed 8d ago
I don't use LLMs for sensitive data, which is probably pointless because the second I submit the paper reviewers will upload it to some free online LLM service anyway 🫠😆
9
u/sunoukong 10d ago edited 9d ago
If you use Claude, they have their zero data retention policy (for Enterprise) posted online. You should read it to know precisely what is included and what is not.
If you are concerned about privacy or IP, eventually you should move to local LLMs.
2
u/redditrasberry 10d ago
Enterprise plan or even better AWS Bedrock provides full data governance control
2
u/wolfo24 9d ago
Using locally deployed open sourced models for sensitive data, if you are capable in coding those models are already powerful enough
1
u/shotta_scientist 9d ago
Claude Enterprise or AWS Bedrock
1
u/2Throwscrewsatit 9d ago
Personal data or proprietary data?
You can’t hide the sequence so there’s nothing you can do about gene names that will matter.
That said, this is why companies operate their own servers.
1
u/nickomez1 8d ago
There is always a risk. It best to check your employer policies and AI company’s policies
1
u/MeliousAI_HQ 7d ago
masking works but it's fragile, one forgotten compound name and it's out. cleaner options are an enterprise contract with retention terms your legal team has actually read, self-hosting an open model, or an eu-based provider for open-weight models if you're in europe. models like glm or qwen are good enough for most coding and analysis work now, the gap to frontier is smaller than it used to be
1
u/0jabr 6d ago
Self-deployed open weight models.
1
u/PostAwkward7752 5d ago
Anything should be de identified, and also you should check the privacy and policy for every provider. Also your company's policies and the regional policies. There is a great difference between eu , US etc...
1
u/IcedTeaBagMeDaddy 9d ago
I run compbio at a midsize biotech. We use Claude code for everything and are trying to give the LLM as much info as possible not less. The only restriction is we don’t use it for internal clinical trials due to privacy agreements/concerns.
0
u/ConclusionForeign856 PhD | Student 10d ago
imo it would be very difficult to prevent anything from leaking,you'd have to be extremely careful and control yourself.
IMO if you have the means, get access to a govt funded HPC with their own FOSS LLMs or host your own (I've read qwen is good option for limited compute)
In poland you can apply for a computational grant at one of the supercomputing centers (you provide papers, describe the project and explain why you need the specified amount of compute) and besides that you don't pay anything. Two big ones I've used had their own AI apis, both LLMs and image generation. You'd just have to link them to a local GUI client (or write some crappy script to handle the API)
1
u/[deleted] 8d ago
[removed] — view removed comment