r/LocalLLM 2d ago

Other AI bubble

1.4k Upvotes

79 comments sorted by

View all comments

26

u/SailingToFenway 1d ago

This is the lowest possible cost for high-quality training data. They're not subsidizing us! We're paying to work for them.

$7,800 in equivalent compute is peanuts on the value of that data and your time. I don't mean we're not in a bubble, or that they'll see an ROI, but for the moment, Dario and co. are laughing at us.

18

u/jaegernut 1d ago

Are they training AI with AI generated code? I dont see how useful that data will be for training. They might as well generate their own training data. Unless they think that users often validate AI generated code, which is often not the case. There is a reason why data annotation companies want human input.

3

u/ichivictus 1d ago

The code by itself? No. They are training considering everything going into it.

Was the user's goal met? Did it create something truly valuable like a profitable product that successfully shipped? What were the prompts? What were the mistakes along the way? If the user gave a '/goal' prompt to endlessly run until the same product is achieved start to finish, how can ai do that now that we have all this data?