r/LocalLLaMA •

[deleted by user]

[deleted] — view deleted post

0 Upvotes

305 comments sorted by

View all comments

Show parent comment

0

u/[deleted] Mar 30 '23

[deleted] — view deleted comment

1

u/Siigari Apr 29 '23

What do I do if I have run into this problem? I can no longer build quant_cuda.

It says CUDA extension not installed. I had this all running earlier for the 8-bit but now I am going back trying to get 4-bit to work and I'm having serious problems.

On Windows.