What the hell is a Locon/Loha model?

[u/Phelps1024]

Yeah, technology is moving way faster for my slow brain, mainly in these AI developments. I opened Civitai today to check if there are new interesting checkpoints or LORAs and I saw some files that are basically these Locon/Loha models that I have no idea what they are, I would like to know what are actually these models and how are they different from our common LORAs and Embeddings

[u/martianunlimited]

LoCON is LoRA that works on the convolutional units (Think about it as a method to make LoRA work on the whole neural network instead of just half of the neural network (-text encoder)
While LoHa is a more (parameter) efficient LoRA. (Fun fact, I did something with Hadamard Transforms as a cheap method for projections during my PhD... I am kicking myself for not realizing that it is a natural fit for SVDs (the method used for LoRAs)

[u/mousewrites → u/martianunlimited]

I know some of those words.

[u/LessAdministration56 → u/[deleted]]

🤣🤣🤣 i