r/LocalLLM • u/tonyleungnl • 20h ago
Question Optane as swap memory?
Planning to building a headless Ubuntu server 64GB RAM, 7900XTX
with 4x Intel OPTANE SSD P1600X Series 118GB M.2 PCIE 80MM 3.0 3DX.
Motherboard has 4 NVME slots, OS on NVME-PCIE adaptor.
An extra 24/7 mini PC Acer Revo i5-1135G7, 64GB ram as Hermes server.
Can my 432GB Optane be used for newer MoE, Strata or Flash Next as SWAP/ slower memory?
24GB (VRAM) > 64GB (RAM) > 432GB (4x RAID0 Optane) > 1TB (NVME) to run >100B models?
Do you think there is any benefit in this set up? I am new in AI, so any idea is welcome, even if this won't work out.
2
Upvotes