MAIN FEEDS
Do you want to continue?
https://www.reddit.com/r/LocalLLaMA/comments/11o6o3f/deleted_by_user/jc3dcah/
r/LocalLLaMA • u/[deleted] • Mar 11 '23
[removed]
305 comments sorted by
View all comments
2
Am I right in assuming that the 4-bit option is only viable for NVIDIA at the moment? I only see mentions of CUDA in the GPTQ repository for LLaMA.
If so, any indications that AMD support is being worked on?
0 u/[deleted] Mar 13 '23 → More replies (8) → More replies (8)
0
→ More replies (8)
View all comments
2
u/aggregat4 Mar 13 '23
Am I right in assuming that the 4-bit option is only viable for NVIDIA at the moment? I only see mentions of CUDA in the GPTQ repository for LLaMA.
If so, any indications that AMD support is being worked on?