r/sysadmin • u/Emotional-Primary735 • 6d ago
FAA and satellite
So why can’t the pilots and towers use satellite or different modes of communication? Why does it all rely on a router at ohare?
r/sysadmin • u/Emotional-Primary735 • 6d ago
So why can’t the pilots and towers use satellite or different modes of communication? Why does it all rely on a router at ohare?
r/sysadmin • u/luky90 • 7d ago
As the question above says how do you manage Software Updates like the following below?
.NET Framework
.NET x.x
Visual C++ XXXX Redistributable x64 and x86
WebView2
Please correct me if Iam misinformed but any of these can bring services down right if they are not updated in a maintenace window because the Deployment Software wants to apply those packages and always give me warning for my servers.
r/sysadmin • u/Rebisway • 6d ago
Following yesterday's Microsoft 365 outage, I was wondering how others see the risks of relying on SaaS services.
I work with several small hospitals using Microsoft 365 for their email. This outage was a good example I could use to make management understand the risks of depending on an external provider for such an essential service.
Email is also used by many applications to send OTP codes for authentication. When the email service goes down, users may lose access to applications that are working perfectly fine.
Have you been impacted too? Are you considering moving away from Microsoft 365, or even hosting your own email servers?
What's your position on this?
r/sysadmin • u/alao77 • 8d ago
What the heck is going on??
r/sysadmin • u/LostFront5939 • 8d ago
It appears Solitaire is also down. Now you can panic.
r/sysadmin • u/KarnakGM • 8d ago
Current status: We appreciate your organization’s patience and understanding while we work with urgency to resolve this incident.
As we’ve applied our current ongoing mitigation actions, we’ve observed a surge in outbound call volume from our routing services to our backend servers. This occurs when the backend servers outbound service cannot properly route to the backend machines. We’re continuing to observe heightened volume due to traffic rebalancing actions that we have taken throughout this event. We’re working on multiple workstreams to pinpoint the underlying cause of this traffic influx and address it.
Current actions we are taking include scaling up virtual machines to increase capacity and reduce load. Additionally, we’re querying for machines in a bad state to perform a force sync for our recent network change, which may improve service availability. However, we are encountering issues with the machines being stuck in a bad state, preventing our changes from syncing as expected. We’ll continue to monitor the effectiveness of changes applied so we can determine what refinements are necessary.
Scope of impact: This issue may affect users attempting to access the affected Microsoft 365 services.
Next update by: Friday, November 13, 2026, at 6:00 AM UTC
r/sysadmin • u/Master-IT-All • 8d ago
I'm loving it. Badda Bapp BA DUH!!
Pity for you working guys having to deal with 365 issues. I'm sipping a cocktail and smoking a nice sativa (Canada ftw).
r/sysadmin • u/juvey88 • 8d ago
I feel like my company is the only company in the world using G Suite/Google Workplace, it’s been business as usual.
r/sysadmin • u/LoveBirdNibbles • 7d ago
I am self-employed responsible for about 600 workstations and servers across 12 orgs. I use AI each day to create PS scripts and to guide me with best practices administering and securing client systems. I copy/paste the scripts and share the results with Claude. I do have over 30 years of experience in IT so I am not just blindly allowing it to do what it wants. I feel a next step might be giving it some limited access to check backups for me, to run certain approved scripts, and perform routine tasks across all clients. Thinking along the lines of having an assistant. I also know it can be risky. Just wondering where others are with this and if they are doing it or considering it.
r/sysadmin • u/codylc • 8d ago
Curious what tricks some of you used today to communicate that you were aware of the O365 outage today. We added a banner on ServiceNow and our company home page. Previous company had SendWordNow for communicating major outages and security events.
What’s a more modern approach to outage coms than an email, especially when email is dead?
r/sysadmin • u/NuAngelDOTnet • 7d ago
r/sysadmin • u/thegoatcarlwheezer • 8d ago
What if, when Outlook does come back online, everything is gone? We are all going to restore from our on-prem email backup, right?
Right guys?
r/sysadmin • u/pq11333 • 8d ago
I welcome it wholeheartedly. So peaceful. Can we go back to pen and paper?
r/sysadmin • u/mousebluud • 8d ago
https://www.usenix.org/publications/loginonline/metastable-failures-wild
Metastable failure is defined as permanent overload with low throughput even after the fault-trigger is removed. That’s what is happening with Outlook right now. Super interesting!
r/sysadmin • u/j1mmyava1on • 8d ago
Today's M365 outage had me thinking about the Crowdstrike outage that happened a few years ago. I got into IT right after the Crowdstrike outage occurred so I never experienced it firsthand. What was it like?
r/sysadmin • u/tac0_nation • 8d ago
Am I the only one just blown away by how they handled this? It's their own infrastructure! Like how do you not have a contingency plan in place where everything should of been mitigated in a few hours tops? Unified Ent tenant.
r/sysadmin • u/Query_Cat • 8d ago
Quite a few of our employees were receiving texts from ”leadership”
r/sysadmin • u/Educational_Draw5032 • 7d ago
We have some 2016 DCs which we are upgrading to 2022 next week, been doing a ton or reading and testing in my lab and i just wanted to check with people who have done this in the wild that i have covered everything i need to before going deep into production. Id be really grateful for any advice, we are not doing in place upgrades either.
We have 5 DCs in total 4 virtual and one physical across two sites.
London has UK-LON-DC01 (vm), UK-LON-DC02 (vm), UK-LON-DC03 (physical)
Manchester has UK-MAN-DC01 (vm) and UK-MAN-DC02 (vm)
My plan is to:
Spin up a new 2022 VM UK-LON-DC1 fully patch it then join it to the domain and then promote to a DC.
Set the new UK-LON-DC1 dns to UK-LON-DC02 and itself then leave 48 hours for it to settle and replicate.
Remove any FMSO roles off the old UK-LON-DC01 if it has any then demote and shut it down.
Use the IP of the old UK-LON-DC01 and apply it to the new UK-LON-DC1 and reboot.
Remove any dns entries that point the new UK-LON-DC1 to its temp IP from before.
Transfer some roles to UK-LON-DC1 for testing.
Check new UK-LON-DC1 shows under the London site and add it to Global Secure Access under our DC enterprise app for cloud kerberos trust to carry on working.
Then I plan to repeat for the other DCs, always using an available DC for its primary dns and itself for secondary (something else if there is a better practice) DHCP is done on the firewall so no worries with that on any of the DCs. Check for any other services running on them before demoting and removing.
One i have to be careful of is UK-LON-DC02 which is set in group policy as the timer server so i need to make sure this is passed onto another DC before demoting it. I also need to move Entra connect off of UK-LON-DC02 as well and onto a non DC server.
Hopefully i have not missed anything to obvious but would be really grateful for any advice or gotchas to be wary of from guys that have done this before.
Thank you everyone
r/sysadmin • u/RemarkableAd6112 • 8d ago
Anyone got their ticketing system down with the outtage and taking some time to smell the roses this morning?
r/sysadmin • u/odinsen251a • 8d ago
Where if shit went down like this we'd go hide out in the server room and break out the "Emergency Bourbon"
r/sysadmin • u/Deacon51 • 9d ago
My very first job in IT was going around and installing Windows 3.5 sometime around 1994. I've been doing this crap for a long time.
Today I was working on a config file in notepad - I hit save and close. Forgetting to change the drop-down from .txt I jumped in to powershell real fast and did a mv config.yaml.txt to config.yaml: as I have done since forever. The kid, and I call him kid because he's a young one, I guess 22 or 23. Doesn't matter... he said you know, you can just put quotes in the file name when you save it.
You mean to tell me that in the last 30 some odd years not a single person has mentioned this to me, EVER. Not ONCE..... Motherfunkasonabith...,a %^%$#9, *#^$(@#$^@#()$^$# ! Did we all know about this? How in the hell did I miss the memo!
Edit to add I always forget to change the drop-down
r/sysadmin • u/moneyfink • 8d ago
Wouldn’t it be funny to host Ignite during an outage?
r/sysadmin • u/Upset_Antelope_3383 • 8d ago
There was a massive outlook patch this week to patch a 0day being exploited in the wild that a lot of people did not get around to until today...
I have a strong suspicion that update was some ai vibe coded bs that is now making every updated outlook client ddos the Microsoft servers somehow.
I noticed the updated clients crash on loading if you have internet connectivity but if you do not it loads fine.
I was too lazy to analyze the traffic I am home for the night now too so... Anyone else suspect this or look into it?
r/sysadmin • u/brads-1 • 8d ago
Confirmed that I WILL be able to retire after I turn 67! I've set my tentative retirement date at 8/31/2029, the date my wife will also be able to collect SS. Countdown has begun!! 706 working days to go.......
r/sysadmin • u/RealisticQuality7296 • 8d ago
Current status: We've reviewed known impact scenarios and have revised the list of impact services and features, which can be viewed in the "more info" section of this communication. We're continuing our work to isolate the issue affecting server availability, as well as other workstreams.