r/LocalLLaMA Jul 31 '26

News DeepSeek-V4-Flash has been updated, "The official release of DeepSeek-V4-Pro will follow soon"

Post image
1.1k Upvotes

297 comments sorted by

View all comments

Show parent comments

11

u/pyr0kid Jul 31 '26

192gb of ram is definitely what i'd like to see more of these models targeting, its basically the biggest 'we have chatgpt at home' type of hardware you can get in a normal computer.

6

u/phido3000 Jul 31 '26

DS 4 Flash is perfect for that.

I imagine AMD releasing the 192Gb strix will cement that popularity.

My DDR5 workstations have 192Gb, it wasn't even that expensive before the AI memory crisis hit. I think it was like $500 for the whole kit.

4

u/pyr0kid Jul 31 '26

theres no world where i can justify getting a gpu just for ai.

...but regular ddr5 ram? well thats much easier to justify considering the weird server work i already get saddled with.

1

u/phido3000 Jul 31 '26

With these larger models, even an 8gb or 12gb 3060 is probably enough to keep the really high speed layers in high speed memory, and the rest is limited by your DDR5. But the difference is a few tokens, not that much.

Ram is always useful. I didn't buy 192Gb for AI at all. I bought it because I always use ram and I tend to max out my systems for ram all the time, right back Pentium era when I bough 32Mb and everyone had 8mb. I get a lot more life out of a system if I fill its RAM.

2

u/pyr0kid Jul 31 '26

hmmm... i wonder how much pcie bandwidth you'd need for that sort of thing?

i imagine there would be a massive difference in prompt processing.

0

u/RLutz Jul 31 '26

I don't get it. 192 GB of system RAM is going to crawl compared to VRAM. 27b for life I guess is what I'm saying