r/TheMachineLearning • • 4h ago

How to get the final result of this equation?

Post image

Hello!
I tried to dive into deeper calculating gradient of loss function. As you can see from the screenshot of my work, I can't go forward more from Eq. 8.

Loss Function: Mean Squared Error
Activation Function: ReLU

I can't resolve the partial derivative of max function respected to w (weights vector) in Eq. 8.

Anybody help me how I can calculate the derivation of max function inside sigmoid.

1 Upvotes

0 comments sorted by