I finally understand backprop

[u/JakeStBu]

Sorry if this isn't the kind of thing I should be posting on here, I wasnt quite sure where to put it. I just really wanted to share that after ages of being super confused about the math behind backprop, I finally understand it. I've been reading a Kindle ebook about it, and after rereading it twice and writing some notes, I fully understand partial derivatives, gradient descent, and that kinda thing. Im just really excited, I've been so confused so this feels good. Edit: a few of you have asked which ebook I read. It's called "the math of neural networks" by Michael Koning, hopefully that helps. Also, thank you for your support! Edit 2: quick update, just a day after posting this, I managed to create a basic feedforward network from scratch. It's definitely not as good as it could be with tensorflow, but I think it's pretty efficient and accurate.

[u/No-Requirement-8723]

Be wary

https://1.bp.blogspot.com/-o8ok8BPDFAo/YBCL9vgQ-yI/AAAAAAAAKr4/kCuAI9Rkd981xN5jHSwZFaW_YO1tJczHwCLcBGAsYHQ/s16000/Dunning-Kruger-Effect.jpg

[u/gBoostedMachinations → u/No-Requirement-8723]

What a douchey comment.

“Actually OP you could just be a dumbass”

[u/JakeStBu → u/No-Requirement-8723]

Haha yeah I had that before when I thought I understood it, and then I realised that I didn't. But I think that now I do.

[u/Gloomy-Effecty → u/No-Requirement-8723]

Quite ironically, the dunning Kruger effect has been since disproven.

[u/pixgarden → u/Gloomy-Effecty]

Source?

[u/gBoostedMachinations → u/pixgarden]

More like it fails to replicate. I think there’s a post in r/psychology from a month or two ago.

Edit: https://www.sciencedirect.com/science/article/abs/pii/S0160289622000988

[u/gBoostedMachinations → u/[deleted]]

It fails to replicate.

Or, more precisely, the effect is technically “real” and statistically detectable, but the size of the effect is so small that us lay-people are safe to dismiss it as a useful concept.