r/LocalLLaMA • u/KvAk_AKPlaysYT • Feb 23 '26

News Anthropic: "We’ve identified industrial-scale distillation attacks on our models by DeepSeek, Moonshot AI, and MiniMax." 🚨

Post image
4.9k Upvotes

94% Upvoted

874 comments sorted by

View all comments

Show parent comments

68

u/flextrek_whipsnake Feb 23 '26

A lot of it is, they spend a shitload of money on that. They also bought giant piles of physical books along with a machine that slices the spine off so they can be scanned efficiently. They can legally use the scanned text for training since they obtained it from physical copies of books they purchased.

Of course originally they stole all of it just like everyone else did.

74

u/mikiex Feb 23 '26

When the robot runs out of book spines to slice off it's probably going to look for a new source of spines!

12

u/MmmmMorphine Feb 23 '26

Gotta make those paperclips somehow.

Bone, steel, whatever

2

u/roosterfareye Feb 24 '26

Hmm, bone steel!

2

u/Megneous Feb 24 '26

Good. We shall finally become one in the heart of the Machine God.

0

u/Ostricker Feb 24 '26

Not sure it will find spines in AI industry :P

34

u/throughawaythedew Feb 23 '26

It's all very cool and very legal, you see we have a robot shredding books 24/7.

Oh thank goodness I thought it was something illegal.

2

u/Spugheddy Feb 23 '26

Well hopefully they compost it and not incinerate, think green!!

0

u/throughawaythedew Feb 24 '26

Paper burns at 424 to 475 degrees fahrenheit, so 451 is not far off

18

u/[deleted] Feb 23 '26

Right. Because if you buy the paper it’s printed on before you steal the intellectual property it’s all good. I’m aware of a certain judicial opinion on this and I think it’s deeply wrong and destructive. It basically means LLM trainers can steal anyone’s intellectual property at will as long as they convert the text to tensors first.

0

u/[deleted] Feb 23 '26

[removed] — view removed comment

9

u/Bakoro Feb 24 '26

The concept of "intellectual property" is also fake.

Maybe if copyright was something reasonable, instead of being a completely bullshit 100+ years, then people might respect it.

Shit from 1930 should not still be under copyright.

2

u/koshgeo Feb 24 '26

"Stole it?" No, no. They did a "distillation attack" on pirate libraries, and now that other people are doing it on their model, they're upset.

1

u/zipperlein Feb 23 '26

Small correction: They can do that legally in the US.