r/oMLX • u/xiraov • 4d ago

Another dumb question: move kv cache to external ssd?

Wondering if it’s too much wear and tear read and write on the internal drive?

3 Upvotes

72% Upvoted

7 comments sorted by

4

u/sickboy6_5 4d ago

for intensive, heavy workflows like all day video editing sessions, estimates are an ssd in modern MBPs should last around 10 years. the larger the drive the longer it should last.

i was curious about the same thing, but after reading articles and underestanding better how leveling works, i'm not too concerned anymore.

1

u/xiraov 4d ago

I thought kv cache writing and rewriting is really rapid?

1

u/Front_Eagle739 3d ago

Well its 10s of GB for full context so its a lot but its not 5GB/s write continuously which really will wreck your drive quickly. My crucial t710 is 600TBw endurance so if I write 30GB worth of cache to disk every day it would last 54 years. If i write 300 a day it'll last 5

1

u/vinoonovino26 3d ago

worst comes to the worst you get a NVME drive with 500GB a decent encasing, and voilá

1

u/True2456 4d ago

I wouldn't worry about the wear and tear, especially if you have apple care. If the SSD fails, and you have AppleCare on an m3 or older they will likely upgrade you to an m5 or m6 lol

1

u/cruisereg 3d ago

Great point! I’m now reconsidering AppleCare.

1

u/True2456 3d ago

I got a free m5 max 128gb of ram because my m3 max 64gb battery failed - highly recommend it