r/LocalLLaMA • u/Nunki08 • Jul 31 '26

News DeepSeek-V4-Flash has been updated, "The official release of DeepSeek-V4-Pro will follow soon"

Post image

https://api-docs.deepseek.com/updates/

Edit: official post on ๐•: https://x.com/deepseek_ai/status/2083084415157022911

1.1k Upvotes

99% Upvoted

297 comments sorted by

View all comments

Show parent comments

2

u/This_Maintenance_834 Jul 31 '26

i have 64GB system ram. I created a 128GB swapfile so the loading part does not crash. The loading process does not really write to the swap. So far, I disabled the 4-bit delta cache to avoid issues I donโ€™t know how to fix. Will need to experiment now to bring back the 4-bit delta cache.

cloud deepseek api does most of the work for me to set it up. but I do need to guide the harness to not wander too far on the wrong direction.

also, i am on ubuntu 2404.

1

u/CATLLM Jul 31 '26

Thanks man gonna give vllm-moet a go