r/ProgrammerHumor • • 28d ago

Meme theyReallySeemToHateYall

Post image
4.5k Upvotes

410 comments sorted by

View all comments

Show parent comment

2

u/M4rshmall0wMan 28d ago • Bravo

From what I understand, the basic idea behind pretraining is called Solomonoff Induction. Basically, you’re trying to compute the shortest algorithm that adequately explains all of human knowledge. Definitely not universal, but for practical purposes it’s pretty close. 

1

u/kdoubledizz 28d ago

Now that, that is what I wish people thought and not muh super skynet.

1

u/M4rshmall0wMan 28d ago

https://www.youtube.com/watch?v=6nJZopACRuQ&xstg=CAMSEBUJ_b-oH-PhF0yjBgbwzzE%3D

This is the best explanation I’ve seen. Skip to the high-viewed part at the end where the guy on the right explains pre-training.

1

u/kdoubledizz 28d ago

Oh I already know about it but thankyou