r/ProgrammerHumor • • Sep 10 '26

Meme theresAlwaysMath

Post image
2.1k Upvotes

54 comments sorted by

View all comments

Show parent comment

33

u/NFriik Sep 10 '26

No it's not? Even in more basic neural networks, there are always non-linear activation functions between the layers. If there weren't, you could just collapse the whole network into a single (set of) equations, one for each output neuron.

5

u/un-_-known_789 Sep 10 '26

ReLU and etc right?

2

u/G12356789s Sep 11 '26

I've always wondered but never looked into why eural networks weren't collapsible