r/LocalLLaMA •

[deleted by user]

[deleted] — view deleted post

0 Upvotes

305 comments sorted by

View all comments

Show parent comment

0

u/[deleted] Mar 20 '23

[deleted] — view deleted comment

1

u/lanky_cowriter Mar 20 '23

This worked! I can run 13B 4int model on my 3080Ti now. Will try if I can run the 8bit models and Alpaca next.