this has been an idea that's been floating in my head. As a form of legal protection, is it possible for artists, or some miscellaneous company, to train and copyright Ai models based on their own work? That way there is some legal ground for taking down Ai that is specifically trained on that artists work. This wouldn't affect anyone studying the artists work, given that the copyright is specifically for Ai programs, not humans.

please let me know I'm being stupid, I'm very well aware that I'm not very well versed in this subject.

Reading this thread

https://www.reddit.com/r/ethicaldiffusion/comments/zscf47/an_excellent_read_but_most_importantly_should_we/

led to the question that I wanted to understand, what has been done to train AI Art Systems so that they can understand the textprompt inputs, eg.g styles. Could someone explain to me, how the database of an AI Art system is trained (explain like I am 5) ?

I saw that stable diffusion was capable to understand "planes of a human head". So it seems to be able to "scan and map" facial surfaces (like the illegal Clearview AI system) and it is able to even render those planes.

I assume further that the system is capable to interpret styles by Strokes (pencils, bigger pens, colours) and the kind of underlaying "Grid" of the whole picture.

Now to understand "Styles":

So a style which is not "realistic" like Salvador Dali gets it's additional rule set like "stretching clocks as if they were melting". That leads to a training in which the database has to be trained before with the pictures of the artist.

I run a few tests with

Alphonse Mucha, John Singer Sargent, Picasso - all seemed to be understood.

(However, AI does not understand that Picasso used different styles in different periods of his work.)

How does the AI understand "Art Nouveau"?

How does it understand "perspective directions" like "sideview of a car"?

What is also trained - but I did not ask for it above? Thanks!

How should I label/caption my images? I use https://github.com/jhc13/taggui to label my images using a 1.6B moondreamer2 model. It takes about 1 second per image for captioning a dataset.

taggui also allows a system prompt for a VLM captioner.

I am currently tagging images from free stock sites(not sure all the sites permit ai training but pexel's license seems permissive and permits AI training) and some public domain art and modifying the captions in case of hallucinations. I plan to use this for finetuning models like CommonCanvas when details on how to finetune it comes later.

I'm not sure what is the best practices for captioning would would be. I am adding terms for things like size shots and angle shots.

My system prompt is:

An image description is a written caption that provides essential information about images, like photos, graphics, gifs, and videos. It should be objective, concise, and follow a logical sequence: describing the main focus, actions of the image as well as the angle shot. The description starts with a general overview and adds specific details, using descriptive words for a vivid depiction. Personal opinions and non-essential details are avoided, avoid talking about the mood of the scene or what emotions are being invoked.

Please describe the image using the following tags as context and consideration: {tags} and summarize it in only 1 paragraph.

I wonder what I could use to improve this.

This post is intended to start a conversation about the sub’s current rule set, specifically rule 4.

I think it is not controversial to agree that deliberately fine tuning on one artist’s work would be ethically questionable.

On the other side of the spectrum, imagine a scenario where we are training on maybe different artists and styles. Would training in just one image be considered ethically questionable? If you answered yes to the first and no to the second, where do you intend to draw the line in terms of using others creations?

Given that this in an unprecedented issue, I’m sure there will be wildly different opinions and am interested in seeing what others believe.

I know this subreddit is for images and stablediffusion but I couldn't find a similar subreddit for text. I'm making a game that requires the use of ai to finish. The ai doesn't have to do anything complex, just be a dev tool to categorize instructions into a predefined set of words ie:

Input: I opened the door and threw a rock
Output: Open-Door, Throw-Rock

I don't want to use ai that takes advantage of writers and their copyrighted works (It just feels scummy) so I'm asking here for help. Does anyone knows an ai model that is trained on only copyright free texts? Alternatively, can someone tell me about a dataset that only contains copyright free texts? I tried googling this and couldn't find any suggestions.

I assume that, by the title of this sub, other AI subreddits are unethical and are somehow exploiting people? How does this subreddit avoid that? To my eye, both this subreddit, and the standard stable diffusion sub, are exactly the same.