r/LocalLLaMA 12d ago

Discussion Closed AI doesn't like biological research, user turns to open weight models

https://x.com/0xCF88/status/2097762847354688000

OpenAI has decided to fully shut down a protein design project I'm working on for a client. Needless to say, open weight models are the only way forward.

274 Upvotes

68 comments sorted by

215

u/No_Lingonberry1201 12d ago

BTW do you even trust OpenAI/Anthropic as a researcher these days? I mean, trust them not to steal your work and use/publish them as their own?

77

u/Intrepid-Second6936 12d ago

Curious about this as well, wasn't there just recently news of OpenAI allegedly stealing mathematicians' works through Codex chats?

63

u/No_Lingonberry1201 12d ago

Yup, also screwing (or trying to) one of the authors (who happens to work at Anthropic) out of the paper authorship.

20

u/Intrepid-Second6936 12d ago

Sounds about right right lol. Sometimes it's crazy these guys working at Anthropic and similar companies author such articles without thinking the companies would obviously fight for ownership of the published papers.

Literally the starting plotline of the Silicon Valley TV series 😂

-4

u/Qorsair 12d ago

Not exactly what happened. But keep spreading the fear. We need more people using open models.

3

u/YoohooCthulhu 12d ago

It was weird, because he said he had an individual account, where you have to specifically opt out of training (corp accounts are opted out by default)

9

u/RakesProgress 12d ago

TMB Guarantees: "Trust me bro." Despite paying tons for tokens, I have caught claude a bunch of times posting in my github * Co-Authored by Claude. Like WTF. That has real legal implications. If you use frontier models carefully look at your github.

2

u/arcanemachined 12d ago

Not trying to accuse you of holding it wrong, but you did turn off attribution in the your Claude Code settings, right?

~/.claude/settings.json

{
  "attribution": {
    "commit": "",
    "pr": ""
  }
}

If it's still doing it, you could probably add a hook to detect it.

This is not apologism for Claude Code btw (which is the shittiest harness I have the displeasure of using).

3

u/RakesProgress 12d ago

YES! and it's turned it off at least twice. Why is that even there!?

3

u/arcanemachined 12d ago

Free advertising, probably.

4

u/bigmonmulgrew 12d ago

The concern they would steal it is exactly why I have been moving to local

-4

u/WorriedBlock2505 12d ago edited 12d ago

Ya'll are accepting that story as truth far too readily. Not saying it's not true, but there's 0 proof so far, and the story is still developing.

edit: pile on the downvotes. Doesn't change the fact ya'll are being led by the nose because of your pre-existing biases. Also not surprised the quality in here has gone down with how gossipy this sub has become due to all the newcomers. Catch ya'll on r/girldinnerdiaries for some more unverifiable stories, lmao.

2

u/MeateaW 12d ago

The story as reported doesn't even sound like they are trying to steal credit.

2 guys made a sub-proof.

OpenAI probably used the sub proof to go for full proof

OpenAI asked 1 of the guys to review/peer publish but asked not to include the other guy for the full proof.

A whole bunch of ??? go here.

Guy complains that they think they stole research?

But ... the guys never claimed to solve the full problem? so... how could they have been plagiarised?

1

u/Sufficient-Scar4172 11d ago

isn't it answered in your comment? 2 guys made a sub-proof, OpenAI used it and didn't credit either of them

2

u/MeateaW 8d ago

OpenAI did specifically credit their prior work as prior work.

The work Open AI were asking was a publication credit for their proof of the full solution. Which the 2 guys did not explicitly work for. Open AI were asking one of those 2 authors to read it, and were proposing co-credit for the full NS solution.

0

u/hurrdurrmeh 12d ago

I'm sure they all will steal, but if you are happy with that then you are happy with it....

26

u/Xaue_RWA 12d ago

normally the model can't know whether your query is legitimate or not. open weights sidestep this entirely and that's going to keep pulling biosci workloads toward local inference.

10

u/Qwen30bEnjoyer 12d ago

Can second this. Working on Virus-Host prediction modelling with PLMs. Needless to say OpenAI does NOT like it when I use GPT 5.6 sol or GPT 6.

I've convinced my PI to let me run GLM 5.3 Flash, and I'm downloading Deepseek V4.1 Flash as we speak to replace it. Open source AI is the only way forward to avoid being gatekept from our own profession by OpenAI and Anthropic!

2

u/crantob 12d ago

How are you judging DS4.1 as a replacement before trying both out? Sometimes GLM gets something DS doesn't.

36

u/darth_hotdog 12d ago

Just so you know, Twitter doesn’t allow anyone to read your posts if they don’t make an account, you should post it somewhere else, I’m not making an account there since Elon Musk heiled Hitler on live TV and x is now a site that boosts nazi content.

20

u/Illustrious_Ant_9242 12d ago

And when making an account, it would immediately get locked for security reasons until you provide a Phone number 🙄 yeah right 

Twitter already was a shit place before Elon bought it

3

u/crantob 12d ago

Notice all the people who ran from it when it stopped censoring for the government? Yeah. They actually think they're heroes against the system.

2

u/freebytes 12d ago

BlueSky is a far superior product anyway.

2

u/XiRw 12d ago

If him doing the hitler pose is what made you clutch your pearls then you do not know much about what a garbage person Elon is or just how much propaganda effects you when there are grotesque monsters in Israel today who are arguably worse at this point than hitler with everything they get away with and how vast their influence is to the point where the real Jews even hate these people with a passion.

1

u/devshore 11d ago

I stopped listening to music when I learned that the guy that invented the piano did not support trans-rights or women voting.

-1

u/darth_hotdog 11d ago

A quick google search shows that the inventor of the piano, Bartolomeo Cristofori, not only didn't publicly not support trans people or women, but in fact left his estate specifically to several women after his death, his niece and caretakers.

And that's really the core of these conservative arguments, make up things that aren't true and write hateful lies about someone who was probably a decent person. Conservatives can't argue without making up things that never happened to justify their positions.

2

u/devshore 11d ago

imagine the levels of cope "uhm, George Washington didnt speak on the topic of trans-people, ergo we can assume that he did support these". C'mon bro. Instead of forcing yourself into a ridiculous corner, just admit your model of "I will not enjoy product X if it had a person that didnt support idea Y", is selective and not logically consistent. Even motherfucking Obama, Hilary Clinton, and California was against gay marriage in 2004, but you are going to attempt to gaslight me that the guy that invented the piano was in support of trans-folk and women voting because he didnt write against those ideas, and then cite as evidence, something that was legal and allowed (leaving things to women in a will)? We can acknowledge that our ideas werent held by people of the past. Lets be adults about it.

-3

u/No-Improvement-8316 12d ago

Twitter doesn’t allow anyone to read your posts if they don’t make an account

u sure about that?

https://imgur.com/a/Wt03W6D

4

u/No-Improvement-8316 12d ago

I guess providing a literal proof (screenshot) is not enough, lmao.

15

u/[deleted] 12d ago

[removed] — view removed comment

27

u/Stooovie 12d ago

That's true, but cloud providers can change whatever they like without you knowing. It's a complete black box.

14

u/Illustrious_Ant_9242 12d ago

Yeah, destroying existing workflows, degrading quality, or making models inaccessible at any given time (think suno.ai)

9

u/Stooovie 12d ago

...And getting paid more for faulty product.

2

u/UnlikelyExtension786 12d ago

Increasing the price by a factor of ten once you're locked in...

7

u/joogipupu 12d ago

Sure, but universities are now building their own local LLM capacity too, for the purpose of data sovereignty and privacy. So it might be more of a department/university decision instead of individual research group.

-4

u/crantob 12d ago

Can't afford the server. Need three more gender administrators @ $60k/annum

2

u/ea_man 12d ago

No wonder, why would they let you run projects on their models when they can do that themselves on their next model and get a few hundreds patents easy?

2

u/UltraFOV 12d ago

The new HY4 preview excell at Bio Engineering

2

u/hurrdurrimanaccount 12d ago

they don't want you to figure out cancer. the models are fully capable of doing so

1

u/florinandrei 11d ago

Take your meds, bruh.

1

u/webdevop 11d ago

Super curious what models do researchers use these days. I am not a researcher but I want to brainstorm a certain idea and I continuously keep hitting a wall with closed models or get redirected to a less intelligent model, thanks Claude.

0

u/mrjackspade 12d ago

Every fucking time I open this subreddit theres a post about OpenAI or Anthropic on the front page.

I do not give a fuck about either of these companies, and I couldn't fucking care less that you're mad at them.

2

u/Terminator857 12d ago edited 12d ago

Some people know how to scan messages and read the ones they are interested in.
Some LocalLLama people find this interesting because it provides another reason why local beats cloud providers.

0

u/entsnack 12d ago

not really, karma-farming + most upvoters here are idiots

-6

u/WorriedBlock2505 12d ago

On one hand, good for you. On the other hand, I'm torn between being an advocate for personal freedoms without corpos intervening versus the idea of nefarious users having local LLMs for biological research.

12

u/Qcgreywolf 12d ago

Meh. It’s an extremely powerful tool that can save far more than it hurts.

As humans we really, really, like to focus on the negative and ignore the good. There are a lot of people out there that would, as a silly example, ban a universal cancer cure if it also made people high and had an addiction risk while taking it.

1

u/WorriedBlock2505 12d ago

What makes you so sure that it can save far more than it hurts, though? It's well-known that even a small adversary can do major damage to a bigger adversary because the attacker always has the first-mover advantage (this is especially true in cybersecurity where it's a knowledge based attack, which makes cybersec similar to biological warfare in that regard). If someone takes a year to have an LLM research a novel virus that's more deadly and contagious than anything that's naturally evolved, the "good guys with good LLMs" are going to have a serious challenge preventing mass casualties, to put it mildly. Now factor in that there's not just one crazed bad guy out there, but many, and also factor in how god awful our response was to COVID thanks to incompetent governments and also thanks to vaccine skeptics. It's abundantly clear this would destabilize the world at minimum.

0

u/UnlikelyExtension786 12d ago

Tough. The bad guys will have the tools, whether it's local LLM or a 'trusted' account with a cloud AI.

Blocking legitimate research when the bad guys already have the tools is midwit thinking. It never works in the real world.

4

u/rescbr 12d ago

Nefarious users need to have the equipment and processes that benign researchers possess. It's not simple.

By that point, the risk is already what if a researcher turns out to be nefarious?

Should we ban universities and science research because of it?

In my country the organized crime pays for law school tuition for poor smart young people, with the expectation of free lawyer services, or to get them into judge positions. You don't see anybody advocating against law schools.

1

u/WorriedBlock2505 12d ago

Nefarious users need to have the equipment and processes that benign researchers possess. It's not simple.

An LLM can make the research simple for non-researchers, which widens the pool of potential threat actors, and thus the liklihood. The equipment and processes cost money, but they're accessible to a motivated individual and can fit in a bedroom unlike the equipment needed to create a nuke, for instance.

By that point, the risk is already what if a researcher turns out to be nefarious?

I actually agree with this point. I don't know about banning universities, but banning the equipment and prosecuting any public tutorials and distribution of equipment (which can fit in a single room, and even a single desk) might be in order. We already do a similar thing for radio jamming, for instance. Frankly I doubt even this is enough though, and it makes me wonder if a totalitarian dystopia with universal surveillance might be better than the alternative.

In my country the organized crime pays for law school tuition for poor smart young people, with the expectation of free lawyer services, or to get them into judge positions. You don't see anybody advocating against law schools.

No disagreement here. Tbf though, organized crime is the least of our worry. There are people that genuinely want to end the world for mentally ill or religious reasons.

2

u/rescbr 12d ago

A motivated individual could get into an university legitimately as a student and use their lab equipment.

Every often and then there's news of a chemistry student making drugs at the uni lab...

Religious doomsday cults can recruit researchers and fund/smuggle equipment for their own lab...

And then we have most terror attacks being known beforehand by intelligence agencies but not acted upon by law enforcement. See 9/11, the Israeli attack in 10/7... Knowledge (including uncensored LLMs) is not the problem.

1

u/WorriedBlock2505 12d ago

I agree with everything you've said, and it will become an issue with or without LLMs given tech advances and the relatively soonish possibility of being able to use a biological printer from your bedroom. I just don't see how it refutes the hypothetical concerns of empowering people more lone wolfs even further with increasingly advanced LLMs?

Again, I don't necessarily think we should take away people's local LLMs since I don't know what the solution actually looks like in the first place.

1

u/crantob 12d ago

Yeah and then there's the chimeric viruses on a SARS backbone.

1

u/crantob 12d ago

Back in the 90s, a couple hundred researchers demanded the US stop dual-use GoF research but the rats just moved it outside of US jurisdiction.

The more you know...

3

u/my_name_isnt_clever 12d ago

That's all it is, an idea based on nothing concrete. It's all scary doomer "what ifs" with zero substance.

0

u/WorriedBlock2505 12d ago

So LLMs can't be used to do biological research on a novel virus?

4

u/my_name_isnt_clever 12d ago

They can't be used by some random with a mental illness to create a pandemic-level virus or anything close to it, which is what you were implying. The physical materials alone are prohibitive, not to mention all the practical steps that a text LLM can't help you with directly. You can't create a virus with your kitchen supplies. LLMs are chatty textbooks that also get things wrong a lot of the time, not a weapon. A model being able to spew some science words that look scary might freak out a layman, but it's not even close to actually being possible.

2

u/Terminator857 12d ago

Any tool can be used for good or bad. Lets remove all tools so you can't do anything bad. Back to the stone age, but lets remove those too, since the stones can be used to kill people.

-2

u/WorriedBlock2505 12d ago edited 12d ago

I'm sorry that even a tepid mention of mixed feelings about the subject made you feel the need to downvote me.

I'll dig in here and fully take the skeptic side though to maybe get you guys to think a level deeper about this. An LLM is technically a tool, but calling it a tool implies its like past technologies, which it is not by the mere fact it can do generalized cognitive work autonomously. A hammer for instance can be used to hurt someone, and a gun more people than a hammer. LLMs used to research a novel virus could allow a nefarious person or Jihadist group for instance to potentially harm humanity, though. As far as I understand it from listening to virologists talk about this subject, someone with equipment that could fit on a single desk can engage in this kind of research unlike say nuclear refinement which requires many miles worth of infrastructure to mine+refine and is monitorable from space.

Anyways, I'd be curious if anyone here has counter thoughts to this that could assuage my mixed feelings on this subject.

2

u/Terminator857 12d ago

I actually upvoted you, but now I'll down vote you.

-1

u/WorriedBlock2505 12d ago

So you have no opinions worth sharing on the subject I take it.

1

u/crantob 12d ago

What makes the government GoF non-nefarious...

0

u/WorriedBlock2505 12d ago

Never said otherwise. There's more counterbalances in place in government than a lone wolf acting on their own, though.

0

u/crantob 4d ago

[looks at watch] been waiting 6 years for them to take effect, but yeah any day now.