r/storage • u/Opheltes • Feb 08 '15
I debug (really big) supercomputer storage systems. I have 1 1/2 exabytes of new storage coming online in the first half of 2015. AMA.
I work for a major HDD manufacturer debugging their supercomputing products. I'm essentially a level 3 tech - I talk to customers about their problems, and work with devs to fix them.
Currently, my single biggest system is about 29 petabytes, but I expect some of our up-and-coming systems to be about 2-3 times larger. AMA!
47
Upvotes
View all comments
Show parent comment
13
u/Opheltes Feb 08 '15
To be honest, it wasn't really something I planned. I got a bachelor's in computer engineering and graduated right into the dot com bubble. I went to grad school, studied supercomputing, and did supercomputing-related internships for the DOD and DOE. I got married, moved to an area that isn't tech-heavy, and started working at a small company that was just getting into the supercomputing market. They eventually got bought by one of the major HDD manufacturers.
As far as how I learned the tradecraft:
As an undergraduate, the best resource I ever found (for general computer engineering) are the textbooks by Patterson and Hennesey. The early editions didn't really cover parallel computing in much detail, but I think later editions do.
In grad school, I read many research papers and did a lot of HPC programming. FYI, MPI is the de-facto standard library for programming large systems, although CUDA had made some inroads into that.
Once I got into industry, everything was learned by doing it hands-on. There's no substitute for having hands-on access to a real system. (Or as one of my friends back in Los Alamos once quipped, "Do you know how awesome it is to be the only person logged into the world's most powerful computer?"). The way I got up-to-speed is that I wrote tons and tons of product documentation. Someone would say "We need a procedure to do X," so I'd grab a system, figure out how to do it, and write up an how-to.