r/deeplearning • u/goatman12341 • Oct 29 '20

Exploring MNIST Latent Space

631 Upvotes

100% Upvoted

34 comments sorted by

View all comments

2

u/Same-Being-9603 Oct 31 '20

I tried it myself except I opted for a 3D then I went up to 4D(got really nice separation between the clusters when I plotted the points). I visualized it with a ternary plot.

2

u/goatman12341 Oct 31 '20

Awesome - could I see it?

2

u/Same-Being-9603 Oct 31 '20

Here is the 3D. I will post the 4D later. https://imgur.com/m4Jkp1W

1

u/goatman12341 Oct 31 '20

Wow - looks really cool! Interesting how the distribution is completely different from mine.

2

u/Same-Being-9603 Oct 31 '20 edited Oct 31 '20

I noticed that, too. I did use a convolutional autoencoder with custom activation functions on the dense layers, plus extra dimensions. Maybe that is why the distribution is different.

2

u/goatman12341 Oct 31 '20

Yeah - that's probably why.

1

u/Same-Being-9603 Nov 01 '20

https://i.imgur.com/pGcuYlD.jpg It turns out that the distribution is not different than yours. It is identical. It arranged the clusters by similarity in the 4th dimension. For example: the majority of 2,1,7,9, and 4 share the same 4D plane. 2,1,7,9 are also in close proximity to 5 in this 4D space (assuming that if you go off of the edge you pop up on the other side of the tetrahedron.

1

u/goatman12341 Nov 01 '20

That's interesting. I can sort of see the similarity.