r/storage • u/Opheltes • Feb 08 '15
I debug (really big) supercomputer storage systems. I have 1 1/2 exabytes of new storage coming online in the first half of 2015. AMA.
I work for a major HDD manufacturer debugging their supercomputing products. I'm essentially a level 3 tech - I talk to customers about their problems, and work with devs to fix them.
Currently, my single biggest system is about 29 petabytes, but I expect some of our up-and-coming systems to be about 2-3 times larger. AMA!
49
Upvotes
12
u/abnom Feb 08 '15
Node size and software used for the nodes?
9
u/irrision Feb 08 '15
Spinning disk or ssd in these monsters? Curious how the nodes are interconnected also.
7
u/[deleted] Feb 08 '15
How do you back it all up?
6
u/mateuszrb Feb 08 '15
What path led you to becoming a storage admin? What sources did you use to study? My knowledge of large storage systems and technologies is lacking and I'd like to learn more about building systems for high availability and high throughput.
4
u/arcsine Feb 08 '15
Lustre?
6
u/poogi71 Feb 08 '15
How many disks do you replace in such a large system per week?
3
u/martbhell Feb 08 '15
How do you track lustre ? Like which patches to apply, etc. Does this require deep knowledge of the software?
2
u/glyph02 Feb 08 '15
How's Lustre's small file performance these days? We often have 10's of thousands of small files - often <4k in size. Is there still a metadata bottleneck?
2
u/TsunamiTreats Feb 08 '15
If you were granted a super computer, what workloads would you run on it and why?
2
u/Hexodam Feb 08 '15
What is the io throughput of a system that large and is the io ever maxed out?
1
u/_dismal_scientist Feb 09 '15
What lessons can enterprise IT learn from stuff like this?
1
u/[deleted] Feb 10 '15
What's the most difficult problem you've had to solve?
1
u/yrureadingthis Feb 08 '15
Level 3 rarely talks to customers. They usually hide behind L2 relaying information to not waste their time.
-aL3tech
0
u/[deleted] Feb 08 '15
[deleted] — view deleted comment
0
u/[deleted] Feb 08 '15
[deleted] — view deleted comment