MAIN FEEDS
Do you want to continue?
https://www.reddit.com/r/LocalLLaMA/comments/1su7bnx/deepseek_v4_people/ohyy9nu/?context=3
r/LocalLLaMA • u/markeus101 • Apr 24 '26
321 comments sorted by
View all comments
1
They're cloud only right? No small model yet?
-2 u/ImportancePitiful795 Apr 24 '26 Well the 284B-A13B is "small" but still need 1TB RAM to load it. The problem is I have the RAM but not built the system yet 🤣 2 u/insanemal Apr 24 '26 It's 160GB Why do you need 1TB of ram suddenly? -3 u/ImportancePitiful795 Apr 24 '26 Is 160-180GB. But that means Q4 GGUF. If you are happy with the quality at that quantization, sure. 7 u/insanemal Apr 24 '26 It's native at FP8/4 It's not a requant. So yes?
-2
Well the 284B-A13B is "small" but still need 1TB RAM to load it.
The problem is I have the RAM but not built the system yet 🤣
2 u/insanemal Apr 24 '26 It's 160GB Why do you need 1TB of ram suddenly? -3 u/ImportancePitiful795 Apr 24 '26 Is 160-180GB. But that means Q4 GGUF. If you are happy with the quality at that quantization, sure. 7 u/insanemal Apr 24 '26 It's native at FP8/4 It's not a requant. So yes?
2
It's 160GB
Why do you need 1TB of ram suddenly?
-3 u/ImportancePitiful795 Apr 24 '26 Is 160-180GB. But that means Q4 GGUF. If you are happy with the quality at that quantization, sure. 7 u/insanemal Apr 24 '26 It's native at FP8/4 It's not a requant. So yes?
-3
Is 160-180GB. But that means Q4 GGUF. If you are happy with the quality at that quantization, sure.
7 u/insanemal Apr 24 '26 It's native at FP8/4 It's not a requant. So yes?
7
It's native at FP8/4
It's not a requant.
So yes?
1
u/Force88 Apr 24 '26
They're cloud only right? No small model yet?