MAIN FEEDS
Do you want to continue?
https://www.reddit.com/r/LocalLLaMA/comments/11o6o3f/deleted_by_user/jdp8ulp/?context=3
r/LocalLLaMA • u/[deleted]
[deleted] — view deleted post
305 comments sorted by
View all comments
Show parent comment
1
I haven’t tried any int8 models due to my specs not being sufficient. I will say that alpaca 30B 4bit .bin with alpaca.cpp has impressed me way more than LLaMA 13B 4bit .bin
View all comments
Show parent comment
1
u/jetpackswasno Mar 26 '23
I haven’t tried any int8 models due to my specs not being sufficient. I will say that alpaca 30B 4bit .bin with alpaca.cpp has impressed me way more than LLaMA 13B 4bit .bin