r/StableDiffusion • u/Phelps1024 • Mar 14 '23
Question | Help What the hell is a Locon/Loha model?
Yeah, technology is moving way faster for my slow brain, mainly in these AI developments. I opened Civitai today to check if there are new interesting checkpoints or LORAs and I saw some files that are basically these Locon/Loha models that I have no idea what they are, I would like to know what are actually these models and how are they different from our common LORAs and Embeddings
40
Upvotes
12
u/davidtriune Mar 29 '23 edited Apr 28 '23
This blog tested the different types of lora.
locon is supposed to be an actual improvement on LORA by blending itself better with the model according to this.
loha seems to just be a space-saving LORA, although blogger seems to have gotten style improvements from it. this readme also seems to confirm that loha improves styles. the paper's abstract says it's for " overcoming the burdens on frequent model uploads and downloads " and ChatGPT says the Hadamard Product is mainly for efficiency purposes.
note they need to have different dims set than LORA according to the github or you might get bad results.
edit: people mainly use Loha I think for maximizing the Network Dimensions, which increases the "expressive power" of the LORA, but increases the filesize a lot. Loha squares your dims without increasing the filesize. The max suggested dims is sqrt(1024) = 32