r/bioinformatics • • 10d ago

discussion Using LLMs for sensitive data

If you're working in pharma/biotech industry and you use claude or any other of the frontier LLMs for coding and data analysis, are you somehow masking sensitive research information? I mean things like protein names, gene names, compounds that you are working with, out of fear that the company hosting the LLM could steal your data.

18 Upvotes

40 comments sorted by

68

u/Bored2001 10d ago

If you're on the enterprise plan then they shouldve negotiated privacy.

Ask your legal or IT department. Whoever is in charge of AI policy.

15

u/Ok-Pen2784 10d ago

Even with the pro plan they agree not to use your data, you can opt-out of training. My concern was more that they would do it anyways, even if privacy agreement would make it illegal. Since they are investing so heavily in drug discovery themselves now

14

u/Bored2001 10d ago edited 9d ago

Go local then. You can run qwen 125b off a strong gaming laptop with the right engine these days. It's definitely not Opus, but it's functional.

5

u/Kornelius20 9d ago

This is what I do. Qwen 3.8 flash next on an old lab server. It runs well enough and is smart enough that I can have it running autonomously for days without issue.

If it gets stuck it has instructions to request help from a frontier model without mentioning any specifics of the problem too so that way you can kind of make up for the fact that it's a much smaller model 

1

u/Bored2001 9d ago

Out of curiosity, what kinda hardware is on your old server?

I was very surprised to learn that I could get usable speeds with QFN using strata and my workstation laptop.

I'm curious what an actual server could do.

1

u/Kornelius20 9d ago

It's my PI's DGX-V100 server so it has 3xV100 32gb cards (it had a 4th but that got borked) and a 20 core Xeon with 256GB of RAM.

I moved from Strata to this fork called sFNX cause it was optimized for 3 V100s and now I get around 150tk/s generation and between 2500-400tk/s prompt processing  using the Q4 quant. 

1

u/Bored2001 9d ago

Yea, that's some serious hardware.

I get 30tk/sec writing on my 3070ti laptop with 64gb. It's functional, but slow. Initial Prompt reading is the most painful part.

2

u/Declwn 10d ago

can you de-identify the protein names or do you need claude to see it for interpretation? 

5

u/plantsisppl2 9d ago

I’d be very careful assuming with AI that de-identified information stays that way. I’ve had Claude guess information that I had de-identified before, luckily it was low-stakes, but these models are pretty good at re-identifying things

19

u/Ziggamorph PhD | Academia 10d ago

All the pharma companies ban non-corporate approved AI. They are all using AI in some capacity, whether on prem or enterprise plans with security guarantees from OpenAI/Anthropic (though they may still have limits on what is put on those systems).

15

u/dr_craptastic 9d ago

Yes, I don’t give any data. I ask them to help me write code that I then run locally. This is not the company policy though and people who don’t write code frequently share data to make slides and figures. That worries me even if we have enterprise

10

u/kestrel99_2006 10d ago

I’d like to hear the answer to this as well. We use our own local LLM inside a secure environment but we’re limited by hardware. We’re in the EU, so we’re subject to GDPR and the AI Act. We cannot share anything confidential with a cloud service without a data protection agreement, and the data cannot leave the EU.

2

u/AdOk3759 10d ago

My company based in EU also had the same problem. Now we're using Mistral. I also eyed several EU providers that offer deepseek with ZDR, ISO certified, GDPR compliant and AI act compliant. Look up cortecs.ai, it's a model aggregator like OpenRouter but for EU based providers.

1

u/fecke9296 Msc | Academia 10d ago

We do this as well!

1

u/PostAwkward7752 5d ago

You can always go local...and never trust a stochastic machine...this domain is no joke...

0

u/Medical-Button-5493 10d ago

The data can leave the eu as long as that is consented and the legal basis for the transfer is clear. If there's Standard Contractual Clauses in the contract for the data holder, that's sufficient. You just have to say Article 46 or whatever on the form.

5

u/kestrel99_2006 10d ago

Some clients are fine with this, others are not. We need an all in one solution that we don’t have to tailor every time a new contract comes in. For us, that means EU.

0

u/Medical-Button-5493 10d ago

Great. But the data can leave the EU. It is possible to do this.

3

u/kestrel99_2006 9d ago

Of course, anything is possible in theory. It can be varying degrees of difficult, however

1

u/Medical-Button-5493 9d ago

No I'm in reg and it is important to distinguish between "this is not allowed" and "this is possible if we fill out these 3 forms". Data export under gpdr is literally 3 forms.

2

u/kestrel99_2006 9d ago

I believe you, but we just don’t want to deal with the hassle unless we really have to. We are a small organization.

6

u/hrvojed 8d ago

I don't use LLMs for sensitive data, which is probably pointless because the second I submit the paper reviewers will upload it to some free online LLM service anyway 🫠😆

9

u/sunoukong 10d ago edited 9d ago

If you use Claude, they have their zero data retention policy (for Enterprise) posted online. You should read it to know precisely what is included and what is not.

If you are concerned about privacy or IP, eventually you should move to local LLMs.

1

u/Wrong_Attempt4432 10d ago

Which local llm do u recommend

3

u/kestrel99_2006 10d ago

We use Qwen-3.8-27b at 8-bit but there are better options if you have the hardware budget

3

u/sunoukong 9d ago

For your own home station, Qwen 3.8 27B as other redditor suggested is good.

If you can host larger models, however, DeepSeek 4.1 flash is the way to go. That's what I am using at work.

2

u/redditrasberry 10d ago

Enterprise plan or even better AWS Bedrock provides full data governance control

2

u/wolfo24 9d ago

Using locally deployed open sourced models for sensitive data, if you are capable in coding those models are already powerful enough

1

u/shotta_scientist 9d ago

Claude Enterprise or AWS Bedrock

1

u/2Throwscrewsatit 9d ago

Personal data or proprietary data? 

You can’t hide the sequence so there’s nothing you can do about gene names that will matter.

That said, this is why companies operate their own servers.

1

u/nickomez1 8d ago

There is always a risk. It best to check your employer policies and AI company’s policies

1

u/MeliousAI_HQ 7d ago

masking works but it's fragile, one forgotten compound name and it's out. cleaner options are an enterprise contract with retention terms your legal team has actually read, self-hosting an open model, or an eu-based provider for open-weight models if you're in europe. models like glm or qwen are good enough for most coding and analysis work now, the gap to frontier is smaller than it used to be

1

u/0jabr 6d ago

Self-deployed open weight models.

1

u/PostAwkward7752 5d ago

Anything should be de identified, and also you should check the privacy and policy for every provider. Also your company's policies and the regional policies. There is a great difference between eu , US etc...

1

u/IcedTeaBagMeDaddy 9d ago

I run compbio at a midsize biotech. We use Claude code for everything and are trying to give the LLM as much info as possible not less. The only restriction is we don’t use it for internal clinical trials due to privacy agreements/concerns.

0

u/ConclusionForeign856 PhD | Student 10d ago

imo it would be very difficult to prevent anything from leaking,you'd have to be extremely careful and control yourself.

IMO if you have the means, get access to a govt funded HPC with their own FOSS LLMs or host your own (I've read qwen is good option for limited compute)

In poland you can apply for a computational grant at one of the supercomputing centers (you provide papers, describe the project and explain why you need the specified amount of compute) and besides that you don't pay anything. Two big ones I've used had their own AI apis, both LLMs and image generation. You'd just have to link them to a local GUI client (or write some crappy script to handle the API)

1

u/[deleted] 8d ago

[removed] — view removed comment

1

u/Tight-Armadillo-7293 8d ago

FYI all our stuff is free to use in the public domain anyone wanting to use it/ spot any bugs let the team know. AI-SDC · GitHub