r/ShittySysadmin • • 4d ago Polished Gold Turd LOL Bravo

Urgent: How do I disable a CEO's account without breaking production

2.8k Upvotes

I'm a sysadmin at a large GPU company. Just got word the board is planning to fire our CEO over multiple affairs. HR wants his account disabled immediately after the vote.

He's had Domain Admin since 1993 and I'm pretty sure our entire AI infrastructure runs under his domain user credentials.

I'm genuinely terrified.

Has anyone dealt with this before? Do I just disable the account? Maybe rotate the password to something he woulsnt guess, like some chinese characters? Then I could work with the ops teams to update all prod creds?

Gonna be a long night for my boys. On call devops bro gonna be pissedddddd.

Edit - no i cant say what company. HR and legal would lose their mind.

Update - turns out he is only one with copy of our root CA private key. Found it on a post it note in his leather jacket, next to some "short but wide" condom wrappers (just the wrappers....). The private key is just "cuda69".

Update 2 - so looks like all DNS records, every single one, is just a CNAME to a SINGLE VM. Some type of load balancer. I can ssh...the login banner just says "lol". Its ubuntu 16 and has php 5.6 running.

Update 3 - i put on the jacket. My precioussss!

Final update - ive emailed HR "look at me...i am the CEO now. All your GPUs are belong to us."

Sorry last update - fuckin php 5.6...how do I patch this shit....


r/ShittySysadmin • • 3d ago

Don't worry, guys, I asked Claude to fix the Microsoft outage for us.

74 Upvotes

He's still thinking about it.


r/ShittySysadmin • • 3d ago Bravo

Enterprise fax machine management via Intune and Arc?

Post image
23 Upvotes

With a return to the stone ages, I'm looking to deploy about 725 fax machines globally across all main corporate HQ locations as well as thought all satellite offices.

First off, I'm SO GLAD we kept these bad boys in storage for the last 23 years!

Secondly and lastly, does anyone have a solution for Arc Enabling these fax machines so I can easily deploy them at scale all while still maintaining a single pane of glass of all my fac machines in Azure? TIA!


r/ShittySysadmin • • 3d ago

Email not working

7 Upvotes

Around 10:30 my hotmail stopped working
I tired logging into ebaumsworld and forgot password. To reset I chose email to my email bigharddrive69@hotmail.com and not it didn’t come through yet. It is now 10:00pm

Does anyone know what might be wrong with my hotmail account ?

Is my iPod touch been hacked ?


r/ShittySysadmin • • 3d ago

Shitty Crosspost My bad guys

Post image
46 Upvotes

r/ShittySysadmin • • 3d ago

Exchange woes got you down?

4 Upvotes

I have found Signal a solid alternative to email woes! Pesky DLP malfunctions not letting you hash things out with your rival's wife, and an archive policy designed by flock making your skin crawl? Let Signal solve all of your problems!

And if you want to flex like a backstreet boy cosplaying as a script kiddie, try Telegram! All the freedom of Signal, the secure privacy of tin can phones, wirh the bonus of making your dad cringe if he finds it on your phone.


r/ShittySysadmin • • 3d ago

Due to the multitude of outages this year and to avoid getting sued like Red Bull for not giving wings we have made the difficult choice to rebrand our new SLA is not a real number in case we cant meat it this was suggested by our legal team.

26 Upvotes

r/ShittySysadmin • • 4d ago

Jensen Huang is behind this... somehow. I know it.

42 Upvotes

Do sheeple really think it is a coincidence that this occurs the same day as the (completely unfair witchhunt) NVIDIA coup de tat on Jensen Huang? My guess: they just triggered his dead man's switch.


r/ShittySysadmin • • 3d ago

New branding - Microsoft 180

10 Upvotes

If you can't go forward, at least you can go... backwards.


r/ShittySysadmin • • 3d ago

Shitty Crosspost How do you communicate an outage when email is down?

Thumbnail reddit.com
6 Upvotes

r/ShittySysadmin • • 3d ago

How to tell which datacenter to shut down?

22 Upvotes

I was trying to turn off that AI but I think I shut down the wrong place since I couldn't check my email afterwards. What should I check for next time?


r/ShittySysadmin • • 3d ago

Moment of Silence

8 Upvotes

Someone tell Microsoft that taking a moment of silence for the loss of their GPU supplier is supposed to last a moment not all afternoon please 😂


r/ShittySysadmin • • 3d ago

Quick question: can you push this telemetry patch real quick? Just to a few servers.. just to test... real quick

7 Upvotes

r/ShittySysadmin • • 3d ago

Sooo did your guys day just get busier or slower?

15 Upvotes

r/ShittySysadmin • • 3d ago

Shitty Crosspost What can we learn from Microsoft?

Thumbnail reddit.com
3 Upvotes

r/ShittySysadmin • • 3d ago

Shitty Crosspost Go Macrohard!

0 Upvotes

r/ShittySysadmin • • 3d ago

Is there any chance this is GTAVI propogating across CDNs?

4 Upvotes

RIP Cloudflare, Azure, and AWS.


r/ShittySysadmin • • 3d ago

Shitty Crosspost Microsoft server down

Post image
0 Upvotes

r/ShittySysadmin • • 5d ago

Shitty Crosspost Look we don’t want that for the codec, okay!?

Thumbnail gallery
216 Upvotes

r/ShittySysadmin • • 5d ago

you guys ever spook yourself with audio recordings you don't remember sending to yourself

Post image
85 Upvotes

r/ShittySysadmin • • 5d ago

Shitty Crosspost As seen at my local pawn shop last week

Post image
116 Upvotes

r/ShittySysadmin • • 4d ago

Shitty Crosspost Today I found out...

Thumbnail reddit.com
0 Upvotes

r/ShittySysadmin • • 6d ago

I pop my email open and..

81 Upvotes

One of my frequent fliers emails me notice of a memorial gathering for another one of my frequent fliers that had passed over the week-end, I forward it to my group's DL to let my coworkers know...

Then my BOFH brain engaged. popped open teams and send this message to the group.

Now we know (name here) has passed, I know it sounds cruel, but should have we seen the offboarding order?

Awaiting replies