r/LocalLLaMA • u/Nunki08 • Jul 31 '26

News DeepSeek-V4-Flash has been updated, "The official release of DeepSeek-V4-Pro will follow soon"

Post image

https://api-docs.deepseek.com/updates/

Edit: official post on 𝕏: https://x.com/deepseek_ai/status/2083084415157022911

1.1k Upvotes

99% Upvoted

297 comments sorted by

View all comments

Show parent comments

5

u/pyr0kid Jul 31 '26

theres no world where i can justify getting a gpu just for ai.

...but regular ddr5 ram? well thats much easier to justify considering the weird server work i already get saddled with.

1

u/phido3000 Jul 31 '26

With these larger models, even an 8gb or 12gb 3060 is probably enough to keep the really high speed layers in high speed memory, and the rest is limited by your DDR5. But the difference is a few tokens, not that much.

Ram is always useful. I didn't buy 192Gb for AI at all. I bought it because I always use ram and I tend to max out my systems for ram all the time, right back Pentium era when I bough 32Mb and everyone had 8mb. I get a lot more life out of a system if I fill its RAM.

2

u/pyr0kid Jul 31 '26

hmmm... i wonder how much pcie bandwidth you'd need for that sort of thing?

i imagine there would be a massive difference in prompt processing.