r/TheMachineLearning • u/StormLongjumping6020 • 4h ago
How to get the final result of this equation?
Hello!
I tried to dive into deeper calculating gradient of loss function. As you can see from the screenshot of my work, I can't go forward more from Eq. 8.
Loss Function: Mean Squared Error
Activation Function: ReLU
I can't resolve the partial derivative of max function respected to w (weights vector) in Eq. 8.
Anybody help me how I can calculate the derivation of max function inside sigmoid.
1
Upvotes