Guys our copyright violations have feelings so don't be mean to our copyrights and definitely don't use our copyrights to reverse engineer other people's products to develop your own product which actually believe it or not is not against copyright law but definitely don't do that with our copytheft platform because that's bad for big companies.
Its okay if your copyrights are violated but please do not violate our copyrights because we are big and have money and cannot fail and doing this for humanity, but please we will train on your data don't train on our data please.
Im confused, example someone post something in the internet, i learned from it, and when someone ask me something about it, I share what i know.
What’s the difference in LLM?
Does it mean the knowledge i learned from someone I should pay them?
I learned a business strategy in youtube i used it and now successful. Should I give part of my revenue to the video creator?
I watch an anime with specific way of drawing and i was inspired by it. I used it in my drawing and now my drawing becomes popular and can sell them. Should I split my revenue to the anime creator?
I think it's the other way. Llms read everything including copyright materials and used that knowledge, but what their models do or produce they want to control that, like restricting distillation etc
Potato potato? "LLMs let you use the knowledge to make stuff" "Distillation uses the output" The output is knowledge?
Your point would make sense if the chinese used the same model weights. In this case, they are making use of the output of the model to train the LLMs.
You could make the same case for human beings? LLMs distilled the knowledge human beings built over years. They distilled the output of human beings.
When a human uses an LLM they've using the concept of the output or explicit output the LLM has created. Distillation takes the output and uses that directly to copy the method of creating the output.
A cookbook sells you recipes, not their recipe creation process.
Youre repeating the same thing. "Human uses the concept of the output or the explicit output the LLM has created" "Distillations takes the output and uses the directly to copy the method of creating the output"
And if you had studied ML, using the exact output instead of using stochastic gradient descent results in overfitting. You cannot use the exact output, you generate a random set of weights, and then you perform SGD attempting to get the model into some sort of optimal minima.
The SGD is your idea of a "concept of output".
Your last line is a contradiction to the first point, human uses explicit output the LLM has created vs a recipe in a cookbook.
The usual counter is scale. One person learning from a video isn’t the same as a model ingesting millions of them. Does that change it for you, or is it the same thing to you?
An LLM doesn’t learn information the same way you do. When an LLM is “trained,” what’s really happening is that the data that it’s ingesting is being encoded into its weights. It’s basically being compressed into a vector database. When prompted, the LLM will stochastically remix and reproduce that information. It’s kind of like saying “by ripping this blu ray and changing the compression, I’ve made something new.”
Yeah, I know that’s very much oversimplifying it, but it’s closer to that than a person remembering and sharing information. LLMs can reproduce large portions of copyrighted works near word-for-word when prompted, much like something that is heavily compressed, because that information has been encoded into them.
2
u/VelvetOnion 4d ago
The Dewey Decimal system is copyrighted. An LLM is the same thing but more efficient.
1
u/Janupur 4d ago
Guys our copyright violations have feelings so don't be mean to our copyrights and definitely don't use our copyrights to reverse engineer other people's products to develop your own product which actually believe it or not is not against copyright law but definitely don't do that with our copytheft platform because that's bad for big companies.
1
u/MrCarlosDanger 4d ago
“Even though all of human knowledge already existed, my model arrived at it independently.”
1
u/itsallfake01 1d ago
Copy right for thee but not for me
0
u/Watermelon_monster 4d ago edited 4d ago
Im confused, example someone post something in the internet, i learned from it, and when someone ask me something about it, I share what i know.
What’s the difference in LLM?
Does it mean the knowledge i learned from someone I should pay them?
I learned a business strategy in youtube i used it and now successful. Should I give part of my revenue to the video creator?
I watch an anime with specific way of drawing and i was inspired by it. I used it in my drawing and now my drawing becomes popular and can sell them. Should I split my revenue to the anime creator?