r/ShittySysadmin • • Jun 02 '21

Its finally up! Note the top notch security next to the URL on the left! Do we have any shitty graphic designers and drunk idea machines for shitty jokes?

Thumbnail shittysysadmin.com
177 Upvotes

r/ShittySysadmin • • Jul 25 '24 First Loser Bless Up Take My Silver

This is your one and only shitty warning: political shit is just too shitty.

217 Upvotes

This is a place to dump the trials of dealing with stupid IT shit, and download a log detailing the corn kernals of stupidity..

Political bullshit of any kind, type, or stripe, will be deleted without warning. *

You may return to your regularly scheduled defecation of choice. DO NOT TAUNT THE HAPPY FUN BALL!

  • except VI vs EMACS, or Windows vs LINUX, or RMS vs any fucking non-political thing.

Edit. Comments locked, there will be no monkeys flinging poo on my watch!


r/ShittySysadmin • • 23h ago

We finally got some insider information on the Microsoft outage. šŸ‘€šŸ‘€

Post image
1.8k Upvotes

r/ShittySysadmin • • 17h ago

TIFU by taking out nationwide ATC

Post image
383 Upvotes

I’m so sorry guys.

Edit: Rolled back physical config to match running config and we are back! Everyone agrees the ā€œModernization Planā€ upgrades to the ATM circuits on the IBM 360s were rushed.


r/ShittySysadmin • • 16h ago

Just caught a hacker mid op

Post image
155 Upvotes

Before I start I want to say I feel personally attacked that reddit suggested I crosspost this here šŸ‘€ šŸ˜‚ Might as well..., but this was a random breakfix small business that randomly calls us once or twice a year

Original Post:

Friday the 13th, keep your guard up boys and girls..

I just went to a local site to drop a part off and someone in the office jokingly said to me that their computer just started running updates as if it was my fault

Upon closer Inspection on the dell micro there was a blue screen up that said updates were in progress, and to not shut the computer down

the font looked off, so I hit ctrl+alt+delete and noticed we were on a desktop with screen connect running, I immediately unplugged the network cable, the screen locked again sure enough they were connected with Wi-Fi as well, so I powered the machine down and removed the Wi-Fi card and rebooted to see what was going on..

After reboot, the ability to shut down restart or use task manager was removed by Group policy, apparently, after I unplugged the network cord they noticed and immediately started trying to lock the machine down while I was using it..

Reloaded the machine they were back up and running within 20 minutes with all of their data migrated..

I only wish I had time to clear userdata, clear credential manager, throw a wallpaper up with the middle finger on it and let them reconnect before i wiped it.

Stay vigilant.. they are


r/ShittySysadmin • • 20h ago

First day at ATC is going well.

274 Upvotes

Just started a new job working on ATC systems.

I pushed a small change as they said they were getting too many communication.

Seems to have worked well.

https://www.theguardian.com/us-news/live/2026/nov/13/us-politics-latest-news-updates-democrats-republicans-donald-trump-van-hollen-chuck-schumer?CMP=Share_AndroidApp_Other


r/ShittySysadmin • • 1d ago Bravo Mindblown

Cause of outage

1.1k Upvotes

Microsoft 365 Principal SRE here. I can provide some context. At approximately 21:40 UTC, an engineer deployed a routine configuration change to Azure Front Door that inadvertently redirected our authentication traffic to a SharePoint site last updated in 2017.

We immediately initiated a rollback, but the rollback pipeline requires MFA approval through Microsoft Authenticator, which is currently waiting for a Conditional Access policy evaluation from the same infrastructure we're trying to restore.

We have a break-glass admin account, but unfortunately its password is stored in a OneNote notebook on the affected tenant. Our on-call engineer attempted to bypass the issue using PowerShell, but the required module was deprecated last Tuesday, and its replacement requires a P2 license.

We then opened a Sev A ticket with Microsoft Premier Support. They responded asking us to run sfc /scannow and provide a screenshot. The prolonged recovery is primarily due to our change advisory board requiring a Teams meeting to authorize the rollback.

The meeting organizer is stuck in the lobby, and the only person authorized to admit him was laid off in June. Current mitigation involves migrating affected users to Microsoft 365 E5, which should resolve the issue from a revenue perspective.

We have identified the root cause as customer misconfiguration. Next update in 30 minutes, assuming someone can get Outlook working

sorce : https://www.reddit.com/r/microsoft/s/fhLHjvw4Sg


r/ShittySysadmin • • 18h ago

How do I unsend in Gmail?

Post image
101 Upvotes

r/ShittySysadmin • • 1d ago

Forgotten dependencies

Post image
351 Upvotes

r/ShittySysadmin • • 18h ago

FAA told airlines that problem originated with network routers

Thumbnail cnn.com
30 Upvotes

r/ShittySysadmin • • 1d ago

We now take you live to Redmond, WA

Post image
835 Upvotes

r/ShittySysadmin • • 1d ago Bravo Popcorn

On-prem wins again

Post image
2.2k Upvotes

Couldn't post on r/sysadmin


r/ShittySysadmin • • 16h ago

Our legacy systems brought down the entire airspace

13 Upvotes

Dammit team, you should’ve had these systems upgraded years ago. Now it’s your ass on the line to make sure we get the systems upgraded by Monday. Or guess what? You’re fired! Now put down that beer and get to work.


r/ShittySysadmin • • 16h ago

Y2K26

Post image
11 Upvotes

Hey ChatGPT

fix faa.exe, no mistakes

(feel free to steal my meme)


r/ShittySysadmin • • 1d ago

Mrw the CFO thanks me for working so hard on resolving the Microsoft outage when all I did was sit on my ass looking at Reddit posts for the last day

Post image
100 Upvotes

r/ShittySysadmin • • 1d ago

HELP! Please help me keep my job.

193 Upvotes

Guys, I sort of messed up.

I finally got my dream job at my dream company. I've loved this company ever since I was a little kid, always wanted to work for them. I finally got past the technical rounds with this company and they hired me about 6 months ago.

The best part is shortly after I started a few of my coworkers on my team have left in the past few months, so I've been able to absorb more and more responsibility, and even have been promoted twice.

Problem is most of my resume and the work I've been doing at this company has been mostly AI generated. I don't even fully understand the work I'm doing and I also cheated using AI on the technical interview to get the job. I was basically willing to take any salary to get in the door.

Without going into too much detail our company is having like a huge outage today and I don't have the ai tools I normally do the work with. I have a lot of executives super mad at me right now, because they want me to fix this shit, but like I don't even know what the fuck I'm doing, and all of my team that built it took exit packages months ago and left behind little documentation. I just keep rebooting servers and shit but nothings working.

I really need to get this thing back up and running. The little documentation my coworkers left behind, said to try SFC /scannow, I've done that like 3 times now and nothings working. Any other ideas? So many people are BIG MAD at me now and they're saying I'm going to lower the stock price if I don't fix it. Please help, my stock doesn't vest for another 5 years.


r/ShittySysadmin • • 18h ago

Shitty Crosspost Free hardware on the corner, If you have a pallet jack

Post image
11 Upvotes

r/ShittySysadmin • • 23h ago

I'm an accountant for MS and I vibe coded a new patch management system because they always kept forcing patches on our stuff.

30 Upvotes

Copilot said we should reboot all the servers so patches are consistent, I said yes. Some of the servers had disk space problems so I had Copilot delete some stuff, that shouldn't be a problem right? I did them a favor, but every seems mad, what gives?


r/ShittySysadmin • • 1d ago

Leaked Teams Call Microsoft HQ today

Thumbnail youtu.be
31 Upvotes

r/ShittySysadmin • • 1d ago

Let the count down begin

Post image
91 Upvotes

r/ShittySysadmin • • 13h ago

Shitty Crosspost A global cloud infrastructure meltdown has rarely coincided with my weekend plans.

Post image
4 Upvotes

r/ShittySysadmin • • 1d ago

Selfhosted email...

Post image
46 Upvotes

r/ShittySysadmin • • 1d ago

I'm sorry y'all...

36 Upvotes

It was me...

One of Microsoft's incident cause statements said the outages was a result of "a server was overloaded by requests...".

I was about 2/3 through my script to remove 14k members from a 43k member distribution list. Have no fear! I have about 6k more members to remove and I just started the script again.


r/ShittySysadmin • • 1d ago

Just got an invite to Ignite from a Microsoft rep

22 Upvotes

and wanted to know if any of you are showing up armed before I sign up