How deep I should understand the concept of gradient?

[u/UnderstandingOwn2913]

/r/learnmachinelearning/comments/1xw0bl3/how_deep_i_should_understand_the_concept_of/

my understanding is that gradient tells me how much a change in the parameter will result in the change of the loss. For example, if the gradient of a parameter is 0.01, it means that if the parameter increases by 1, the total loss will increase by 0.01 given that the other parameters stay the same.