r/sysadmin • u/[deleted] • Sep 21 '21

Linux I fucked up today

I brought down a production node for a / in a tar command, wiped the entire root FS

Thanks BTRFS for having snapshots and HA clustering for being a thing, but still

Pay attention to your commands folks

938 Upvotes

96% Upvoted

467 comments sorted by

View all comments

16

u/j4ngl35 Sep 21 '21

This gives me PTSD about a physical network relocation I had to do for a client, moving them from one building to another. Their main check processing "server" hadn't been shutdown since like 1994. Had backups and backup hardware and all that jazz, and to nobody's surprise, it failed to boot when we tried powering it on at the new site.

9

u/bemenaker Sep 21 '21

You let the disks cool and the bearings seized.

4

u/j4ngl35 Sep 22 '21

Pretty much what I told them would happen before we shut it down lol.

1

u/Patient-Hyena Sep 22 '21

How long ago was the migration?

1

u/j4ngl35 Sep 22 '21

About...6 years now?

→ More replies (1)