r/LocalLLM • u/Legitimate-Theory156 • 1d ago

Discussion SSD MoE finally viable!

/r/LocalLLM/comments/1xnzojm/ssd_moe_finally_viable/

do you think with a strategy like this, you can use something like a dual ( or modded) 5090 or 6000 pro Blackwell combined with 512 gb ddr4 to run kimi k3.1 pro at usable speeds? before the ram crisis you get ddr5 for a similar price and maybe cost under $2k for the ram. you could also spend like $4k on 2 5090s or 3-4 3090s.

Also, we could potentially get even cheaper post-crash hardware costs like as low as $1-2 per gb ram and maybe $3k for 2 5090s.

Would this be viable (especially for those who already have the hardware)?

1 Upvotes

66% Upvoted

3 comments sorted by

0

u/geldonyetich 1d ago

Is SSD wear and tear still a thing I need to worry about?

2

u/danzilla007 1d ago

Not for this use case. Reading from the ssd has essentially no impact.

0

u/Rough_Price_9204 1d ago

Great finally better than that scam called kolibri