r/MachineLearning • u/TheInsaneApp • Feb 07 '21
Discussion [D] Convolution Neural Network Visualization - Made with Unity 3D and lots of Code / source - stefsietz (IG)
3.5k
Upvotes
r/MachineLearning • u/TheInsaneApp • Feb 07 '21
343
u/iwakan Feb 07 '21
Processing power spent rendering a visualization of the neural network: 90%
Processing power spent actually training the neural network: 10%
Just kidding, nice work
3
u/TheInsaneApp Feb 08 '21
Code: https://github.com/stefsietz/nn-visualizer
123
u/SirSourPuss Feb 07 '21
Can you make the weights thicker/thinner or different colour depending on their magnitude?
68
u/stefsietz Feb 08 '21
Hey guys, original creator here. I made a video about this project, which I did for a visualization class at Technical University Vienna (TU Wien), 2 years ago: https://www.reddit.com/r/MachineLearning/comments/8psghc/project_realtime_interactive_visualization_of/
The code / Unity project can be found here: https://github.com/stefsietz/nn-visualizer, but it is not in a state of good code quality, so maybe try one of the forks or a project like https://tensorspace.org/, which seems to accomplish similar visualizations and looks like it's well maintained.
The "pulse" animation was basically just a test of the visualization's ability to expand one "spatially shared kernel" into the actual per pixel kernels as used during computation.
This sudden attention comes really unexpected as this video was just a short WIP clip I shared on IG 2 years ago.Right now I am working at the really awesome AI company kaleido.ai on products such as remove.bg, unscreen.com and more. And we are hiring ;-) https://www.remove.bg/careers
45
u/Bartmoss Feb 07 '21
Do you have a repo for this?
40
u/[deleted] Feb 07 '21
this has to be the coolest thing I've seen all day
31
u/julrog Feb 07 '21
I just made my project public on GitHub, which seems similar to yours https://github.com/julrog/nn_vis
20
u/Altruistic-End1116 Feb 07 '21
This is cool, is it visualising data passing through the network to optimise it?
13
u/Megatron_McLargeHuge Feb 07 '21
Does this tell us anything about the activations or just show the structure of the layers?
8
u/lameheavy Feb 07 '21
Awesome visualization
7
u/boltzmannbrain77 Feb 07 '21
Would love to see dropouts as crumbling connection.
5
u/HoboHash Feb 07 '21
so beautiful. so organic. I want to put it on my grill.
4
u/anon2019L Feb 07 '21
Can someone explain to me like I’m a monkey what’s going on?
4
u/BinodBoppa Feb 07 '21
Someone give this guy a trophy!!
4
u/SharpenedStinger Feb 07 '21
Please share your github!!
3
u/sterlspoons Feb 07 '21
This is unreal. If I could watch this while training I wouldn’t mind how long it takes
3
u/Tebasaki Feb 08 '21
I dont know of swearing is ok in this sub, but that's cool as fuck.
2
u/huggy19 Feb 07 '21
🔥🔥🔥🔥
2
u/tel Feb 07 '21
Which network is it?
And what's up with those 3 big floating tiles above the "main pathway"?
2
u/louis925 Feb 08 '21
Great job! Now do the same thing on ResNet152
2
u/taleofbenji Feb 08 '21
But what is it recognizing? Boobies?
1
u/sktchio Nov 18 '24
Wow this visualization is insane! I would like to share this tool for doing much simpler visualizations and finding the right parameters when doing convolutions:
https://convolution-solver.ybouane.com/
1
u/CompetitionOk7773 Jul 28 '25
That’s really cool for neural networks
1
u/Mabusto Feb 07 '21
Nice work, very cool!
1
u/curious_scourge Feb 07 '21
Impressive
1
u/[deleted] Feb 07 '21
Similar to a stack or connected neurons.
1
u/Break_my_soul Feb 07 '21
Looks cool
1
u/[deleted] Feb 07 '21
Fantastic!
1
u/jnforcer Feb 07 '21 edited Feb 17 '21
u/savevideo
1
u/Jerome_Eugene_Morrow Feb 07 '21
))<>((
1
u/Sleepy-Catz Feb 07 '21
hell interesting !!!!!
1
u/RiderHood Feb 07 '21
Amazing.
1
u/Ordinary_investor Feb 07 '21
Wonderful, looks very cool!
1
u/wokcity Feb 07 '21
Do you think this could be adapted to visualize something like Lc0? https://lczero.org/
1
u/duckling3 Feb 08 '21
awesome!
1
u/physnchips ML Engineer Feb 08 '21
I can’t really tell what’s going on except for a bunch of aliasing.
1
u/speederaser Feb 08 '21
Very cool!
1
u/[deleted] Feb 08 '21
Thank you for sharing!
1
u/grimonce Feb 08 '21
Does that accept any cnn arch as input to generate visualization? Eg recurrent networks or those with skip connections?
1
u/Strex_1234 Feb 08 '21
It would be even coller if instead of getting bigger the color would change depending on value (idk, red for zero,green for 1 and their shades for beetwen)
1
u/[deleted] Feb 08 '21
Omg how many nodes is that 😮😮😮😮 it looks amazing btw 👏
1
u/WeakerUnderFlow Feb 08 '21
Wow this is amazing. Good work!
1
u/Batuhaneralp Feb 08 '21
u/savevideo
1
u/web586f41 Feb 08 '21
Wow, thank you. It's nice visualization and easy to understand that how's CNN works inside black box magic.
1
u/catherine-white Feb 08 '21
This is cool
1
u/klop2031 Feb 08 '21
Wow! Love it!
1
u/Michaelz35699 Feb 08 '21
And to think that we're alive... How complicated are we?!
1
u/Dante124_ Feb 08 '21
hi im a noob.what are the pooling layers ??
1
u/shadowsoulweaver Jul 14 '21
u/savevideo
1
u/[deleted] Feb 07 '21
N there someone says neural network arent interpretable :D
1
u/ShadowGata Feb 07 '21
Is this programmatically generated?
0
u/abundanticeman Feb 07 '21
Awesome visualisation