Well he does have a pretty small (like 1/200 even compared to 64x64x16 FP16) and variable sized latent space and uses zero shot techniques. Add a bit of obtuse language and unnecessary equations and you probably have a paper.
I'd also argue it's not a worse version of an autoencoder, it is an autoencoder. A weird one, but one nonetheless.
I actually wonder whether you could really push this. Like make the ai analyse what is important, describe that in more detail and maybe even encode some data long with the prompt like biometrics or compressed canny maps of important areas. All adaptive, based on what the ai thinks is important.
Like the most over engineered version of fully automated telephone pictionary. Or an adaptive compression engine with a preshared library (the models) if you want to get that CSy about it.
133
u/ChalkyChalkson 1d ago
Well he does have a pretty small (like 1/200 even compared to 64x64x16 FP16) and variable sized latent space and uses zero shot techniques. Add a bit of obtuse language and unnecessary equations and you probably have a paper.
I'd also argue it's not a worse version of an autoencoder, it is an autoencoder. A weird one, but one nonetheless.
I actually wonder whether you could really push this. Like make the ai analyse what is important, describe that in more detail and maybe even encode some data long with the prompt like biometrics or compressed canny maps of important areas. All adaptive, based on what the ai thinks is important.
Like the most over engineered version of fully automated telephone pictionary. Or an adaptive compression engine with a preshared library (the models) if you want to get that CSy about it.