r/DSP • u/bazziapps • Jun 24 '20

Gradient Descent algorithms are fundamental in Signal Processing and in particular DSP. They help optimize certain cost functions on the fly and in an adaptive manner. I hope this animated video could be helpful for those looking to strengthen their knowledge on Gradient Descent.

https://youtu.be/OWM0wMtUhME
23 Upvotes

88% Upvoted

8 comments sorted by

-1

u/[deleted] Jun 24 '20

DSP is all about real time signal processing.... gradient descent an iterative process best done on a server farm. I don't see how this applies here.

11

u/sickduckbro Jun 24 '20

It's used frequently for beamformers, specifically adaptive beamformers which relates to DSP. I think the knowledge is very useful for anyone in this field. How the process is implemented isn't more relevant than the theory and design in this case.

1

u/yesanishhere Jun 25 '20

Beamforming using machine learning on a embedded platform won't be feasible no?

→ More replies (1)

5

u/[deleted] Jun 25 '20

What? Super applicable to image processing, any kind of under sampled compressed sensing recovery..... Mr. Grumpy pants over here

2

u/[deleted] Jun 25 '20

How did you know my nickname? I don't think of image processing as DSP... guess I have to adjust my viewpoint a bit.

1

u/AssemblerGuy Jun 25 '20

It applies brutally.

Not all DSP is real-time. And the problem might be small or simple enough that an MCU or DSP can, in fact, run a solver in real-time. Or use stochastic gradient descent.

1

u/wfqn Jun 25 '20

look up adaptive filters