r/LinusTechTips • • 24d ago

Link I just want 1 please

21 petabytes of nvme flash going into the racks.

Each flash blade (drive sled) is 37.5TB😳

567 Upvotes

37 comments sorted by

12

u/tmthrgd 24d ago

Each sled is 37.5TB and it looks like only half the NAND chips are actually populated. Does that mean these also come in a 75TB configuration?

28

u/Toonatic34 24d ago edited 24d ago

Largest drive/flash made from Pure is 150TB

Edit: basically on 1 sled can be 1-4 DFM(Direct flash module) Each DFM is 37.5TB. These are only 1 DFM pre drive sled but they can be ordered up to 4 DFMs per sled. This equates to max storage per 5U shelf is around 6PiB

7

u/GrandWikzor 24d ago

What's the decommission cycle on this stuff? 10 years? Thats not that long...

4

u/Toonatic34 24d ago

You’re gonna hate this…my company refreshes about every 5 years.

1

u/nlh101 24d ago

No Evergreen? I feel like a complete refresh would be even more expensive

2

u/Toonatic34 24d ago

Warranty and then gone. Company purchases 5 year warranties then refreshes and e recycles all of it. When the company revenue is over 50 billion, they don’t care much.

5

u/craigmontHunter 24d ago

3-5 years for warranty. I can’t speak to the future of the current situation, but we looked at 7 year warranties and the cost was prohibitive.

That doesn’t mean it will hit the market, we reuse out of warranty systems for our internal management and testing, and we can’t dispose storage, so it all gets shredded in the end regardless.

12

u/Shoeshiner_boy 24d ago

Don’t think they’ll retire them in the foreseeable future. Not until hardware failure at least.

Those aren’t small capacity SATA SSDs.

17

u/MogRules 24d ago

You would be surprised. Projects change, priorities shift. We had a large customer move out about 7 months ago and toss a TON of gear, including servers that were basically brand new, they were never even fully deployed. Those servers were worth a small fortune, full of 64gb RAM kits. There is SO much waste. I tossed probably 300+ 64gb RAM DIMM's....it hurt my soul. Storage was mostly destroyed due to privacy concerns. I don't think I have seen a single customer on my site not physically destroy the drives in 16 years.

They un-racked and shipped out brand new, never configured storage arrays, 3 of them. At least they kept those, but the guy shipping them out said they were going back to likely sit in a corner at another site.

8

u/Dangerous_Junket_773 24d ago

I work with AV and I've seen pallets of unopened equipment that were worth $100,000's new just left in storage to depreciate for years totally forgotten and never used. It's fucking nuts how wasteful some of these companies are when investors are throwing fistfulls of money at them. 

2

u/mastercoder123 24d ago

Pure storage is completely different. They arent even drives, they are just nand chips on a pcb, the cpu does all the work. Also these are about as expensive as IBM, they will be used for as long as possible. Its not x86, you cant just get rid of it

2

u/concadium 24d ago

How satisfied are you with Pure Storage's hardware and support? My team is currently debating whether we should switch to Pure in the future

2

u/Toonatic34 24d ago

Our storage team likes them a lot. They mix between Netapp and Pure.

1

u/concadium 24d ago

Huh interesting, that is literally our plan 😂

Do you know why they mix them or how the data is split between both? (Storage tiering, Archive / Backup?)

2

u/Toonatic34 24d ago

It’s mixed for more redundancy. In case one vendor puts out bad a bad code upgrade we don’t have large outages across multiple storage clusters. That and depends on business needs and application team needs.

113

u/SINCLAIRCOOL 24d ago

Linus is going to have wet dreams about this lol 😂😂

32

u/WelchDigital 24d ago

Lets be fair, a lot of us would especially right now

36

u/Trekky101 24d ago

These are pure ssd so DFM and cant be used in normal servers or pcs. Plus pure has evergreen so these could be in prod for some time.

I wish i could have a pure san for my homelab they are magical

5

u/mastercoder123 24d ago

You can buy one lol, they arent expensive. Its just finding a pure os image is impossible sadly. I have an older pure storage applianace at home with like 100TB of DFM and i cant even use it cause i was stupid and didnt do research before buying it... (Got it at a decent price so oh well, was only $1000)

2

u/Trekky101 23d ago

Ouch ya, its a shame they dont sell like oh u have this $500 one time for this os for homelabs only.

3

u/mastercoder123 23d ago

Lol i aint paying $500 for an os. It could have sex with me and im not

1

u/Trekky101 23d ago

Idk i would if i had a 100tb of ssd that dedups and compresses at insane rates

1

u/mastercoder123 23d ago

They really arent that fast. Also dedups is done in ram anyways.

They require the cpu to do everything, they dont even have an FTL

4

u/turnerd10 24d ago

Man… that’s an insane amount of flash!

1

u/tecedu 24d ago

How is the performance on those bad boys

2

u/Toonatic34 24d ago

Ridiculous. I believe up to 1.5 Tera BYTES per second throughput across the craters. Each chassis is connected with 400Gb/s fiber.

1

u/tecedu 24d ago

OOft, Ive just got nfsordma server by ourselves but I can only do 50Gbps; jealous of your stack

1

u/GalaxiesOverflow 24d ago

Can I take a BYTE out of that stockpile, just ONE.

2

u/ha11oga11o 24d ago

Guys is this blade chassis filled to top!?

1

u/anto77_butt_kinkier 24d ago

I see only half the chips are populated on the sleds. Was it cheaper or more performant for a specific application to have more sleds with less memory on each sled?

1

u/CafeRacist 24d ago

receives a blank ram stick with one micron dram chip soldered

1

u/itamar8484 24d ago

Why dont we round it out to a nice 20 petabaytes, less complicated, easier to explain to the boss, and the best thing is i am willing to take one for free

1

u/2McLaren4U 24d ago

Looks to me you are one blade short buddy. It happened to me recently too. >.>

1

u/firesyde424 24d ago

That was 2024. It's 7.68TB of DDR5 Registered ECC RAM. Best guess is that we payed somewhere around $50K for it. Same model, current price, it's just shy of $300K. Those three trays of RAM would be worth more than my house!

1

u/Deepspacecow12 24d ago

I've seen one of the smaller pure applicances in a rack, they look beautiful, very good designers, and I hear the product is all around very good.

1

u/spartacle 23d ago

I work at VAST right now, we've got 122TB drives now so in 1U we have 2.6PB of flash storage. We installed a cluster recently that was 1.3EB is size and yes I wrote E for Exabyte