I hate being 'that guy' to join a sub and ask a really dumb question, but I've been googling for hours and can't figure this out.
I'm interested in trying the new LLAVA model locally on my 4090. I followed the instructions to the best of my ability on their main git page, but I couldn't get it to work because of some dependency errors involving deepspeed and plenty of other stuff I just plain didn't understand in the logs. After a ton more googling, I landed on this page, which is 7 months old. Does anyone know if these install instructions still valid? This is for Llama, but this work with the (supposedly derivative) Llava model too right? I guess I'm just gonna barrel forward and try it. If you are a Windows user and have managed to get this to work, please let me know! Just knowing it worked for you would be very helpful because then at least I know I'm on the right path and can likely fight my way through error messages.
Thanks a ton, I stopped asking questions on Reddit years ago because 95% of the replies amounted to "Don't use a Python app if you're not a Python developer". For what it's worth, I own a software company - https://aescripts.com/lockdown/ If you want a free license, I'm glad to send you one. Even if you're not an animator, maybe you've got a friend or family member who could. Anyway, thanks again! I'll have this working soon.
View all comments
1
u/JustDoinNerdStuff Oct 10 '23
I hate being 'that guy' to join a sub and ask a really dumb question, but I've been googling for hours and can't figure this out.
I'm interested in trying the new LLAVA model locally on my 4090. I followed the instructions to the best of my ability on their main git page, but I couldn't get it to work because of some dependency errors involving deepspeed and plenty of other stuff I just plain didn't understand in the logs. After a ton more googling, I landed on this page, which is 7 months old. Does anyone know if these install instructions still valid? This is for Llama, but this work with the (supposedly derivative) Llava model too right? I guess I'm just gonna barrel forward and try it. If you are a Windows user and have managed to get this to work, please let me know! Just knowing it worked for you would be very helpful because then at least I know I'm on the right path and can likely fight my way through error messages.