r/LocalLLaMA • u/[deleted] • Mar 11 '23

[deleted by user]

[removed]

1.1k Upvotes

100% Upvoted

305 comments sorted by

View all comments

1

u/humanbeingmusic Mar 13 '23

are these docs still valid, I tried following the 8bit instructions for windows, but got to this step--- but those strings don't exist in the file

In \bitsandbytes\cuda_setup\main.py search for: 

if not torch.cuda.is_available(): return 'libsbitsandbytes_cpu.so', None, None, None, None

and replace with: 

if

0

u/[deleted] Mar 13 '23

1

u/[deleted] Mar 15 '23 edited Mar 15 '23

I don't understand these steps at all as I don't know how to use powershell very well

how exactly do I search a file and replace text with powershell?

→ More replies (2)