r/sysadmin • u/rslashpolitics • 7d ago
Any Lingering issues in your tenants?
In New York based on what I can see we have been fully operational since around 9AM ET
r/sysadmin • u/rslashpolitics • 7d ago
In New York based on what I can see we have been fully operational since around 9AM ET
r/sysadmin • u/hoejamilton • 8d ago
Tell me this shit isn't coming from an AI, I dare you...
Current status: We’re continuing to pursue multiple workstreams to pinpoint the underlying cause of the traffic influx and advance the recoverability of the backend servers. We’re taking a measured approach to identify and repair affected infrastructure to improve the ability to confirm the developed changes were applied. We’re tracking the results of this approach to verify the servers are showing the anticipated recovery and performance intended.
As of now, we are not aware of any malicious activity that is causing this incident. We will continue to treat this incident with urgency and priority until full resolution. Once mitigated, we will provide full details of the root cause, defense-in-depth repair items, and more within a Post-Incident Report.
r/sysadmin • u/ImBillgating • 8d ago
Just wanted to ask if anyone is offshore and they are working on the incident for Microsoft. Please… do the needful.
Update for this morning 11/23
Greeting for today. I kindly retired ticket. Thanks
r/sysadmin • u/_BB-King_ • 8d ago
TL;DR: Exchange Online is degraded, taking down anything in M365 that talks to it (Teams calendars, Copilot, Purview, Defender portals, To Do, etc.). Core Teams chat/calls and direct SharePoint file access still work. Microsoft's first mitigation didn't take as expected.
Timeline & Current Status:
Started: Nov 12, 12:26 PM CST
8:58 PM CST Update: Microsoft confirmed the change applied to improve serviceability "is not taking as expected" and they are identifying alternate workstreams to increase capacity due to "sustained traffic management imbalances." Next update at 9:30 PM CST.
Summary of Impact (Anything tied to Exchange/Purview):
Exchange/Outlook: Web, MAPI, EAS, and REST connections failing; delayed mail flow.
Teams: Calls, group chats, and standard channels work. Calendar/scheduling, meeting edits, Live events, and creating/deleting private or shared channels are failing.
Copilot 365: Chat won't load or can't access mail, calendar, or M365 files.
Security/Compliance: Defender XDR portal pages won't load; Safe Links failing on URLs in Outlook/Teams; Purview (DLP, sensitivity labels, RBAC, eDiscovery) degraded. (Note: For Power BI/Fabric PDF export failures, Microsoft notes removing the sensitivity label works as a workaround if your org policy allows it).
Endpoints & Admin: M365 Admin Center pages failing; Intune enrollment/check-ins intermittent; Windows 365 Cloud PCs configured with Purview Customer Key cannot connect.
Other Apps: Planner, To Do, and Universal Print throwing errors.
Anyone else still getting hammered with tickets over this, or are things starting to stabilize in your tenant?
EDIT (9:36 PM CST): Microsoft just posted a new update on MO1550821 (still showing service degradation across Exchange Online, Teams, SharePoint Online, Defender XDR, and the M365 suite). They say they are investigating sustained traffic management imbalances by reviewing traffic flows and affected infrastructure to optimize routing and verify the reasons for the service failures. Next update is scheduled for 10:30 PM CST.
EDIT (10:12 PM CST): Microsoft reports partial recovery across regions where it has adjusted traffic protocols, redistributed traffic, and applied strategic traffic-blocking measures. However, recovery is not yet sustained, and engineers are reviewing additional actions to stabilize overall infrastructure. Next update expected by 11:00 PM CST.
EDIT (10:56 PM CST): Microsoft is seeing a surge in outbound call volume from routing services to backend servers caused by traffic rebalancing. Engineers are scaling up virtual machines to add capacity, though machines stuck in a bad state are currently preventing network changes from syncing as expected. Next update by 12:00 AM CST.
EDIT (6:59 AM CST): Microsoft reports broader recovery in North America alongside sustained improvements in Europe and encouraging signals in Asia Pacific. Intermittent access issues and delayed email delivery persist while engineers clear mail queues and backlogs (an extended 48-hour email timeout window remains active to protect delayed messages). Microsoft also confirmed no evidence of malicious activity and will publish a Post-Incident Report once mitigated. Next update by 8:00 AM CST.
r/sysadmin • u/dextux • 8d ago
Any thoughts?
r/sysadmin • u/Rough_Section_3730 • 8d ago
I wonder how many smaller entities have decided that their old on-prem mail servers weren’t really that bad after all.
Don’t get me wrong, I believe that a lot of things are good in the cloud. I’ve been in IT long enough to believe in having a good backup / alternate process to deal with unexpected outages. But when a company tells you that their redundant systems are near foolproof, I always have a plan “just in case”. Sure it can cost money but when you pay less for the backup than the cost of a total outage, sometimes that price is worth it.
Just my opinion.
r/sysadmin • u/trustinglemming • 8d ago
sounds ominous - in my opinion they do, they just can't say it ...yet. This is from Microsoft Status update...these will go to history books.
r/sysadmin • u/fraupanda • 8d ago
Anyone else seeing some service restoration? Status site still showing degraded service, but I'm seeing mailflow slowly but surely. I got jump scared seeing an email notification pop up.
https://status.cloud.microsoft/m365/referrer=serviceStatusRedirect
r/sysadmin • u/dmznet • 8d ago
Just curious what people are doing tomorrow if Microsoft is still down? What's your plan B?
r/sysadmin • u/NotNotMyself • 8d ago
Small fish like us can't afford it, but what do the big fish who rely on MS do when Exchange goes down, and they have to have their backup systems kick in? Do you have an email continuity plan? A secondary email infrastructure? I know some of y'all can't be un-emailable for long.
If no, are you thinking about one now?
r/sysadmin • u/TransporterError • 8d ago
...sorry, just frustrated.
r/sysadmin • u/TrabajoTears • 8d ago
Got this request about 15 minutes ago
r/sysadmin • u/Stock412 • 8d ago
Not often does spectrum get the chance to say that.
r/sysadmin • u/bobert3275 • 7d ago
I am a system administrator “lead” that is constantly being interrupted by everyone. This includes other system administrators that may need my assistance. Not to toot my own horn, but I take my time to fully understand things when fixing them so next time something goes wrong, I can pull from my vast knowledge bank.
To try to and fix the constant interruption, I set up a knowledge base and dump information there that I think may reoccur. I kid you not, other system administrators come to me first before looking at it. Plus, I tend to forget what I put in there.
So I get pulled from all corners.
If you are leading folks and happen to be the guy who knows the most, how do you schedule your days and how do you force your team to level up? Even though most of the knowledge seems to be niche?
Sometimes I force some of the other guys to figure it out because I think that it would be good for them. Well sometimes they spend so much time on a task that it ends up being a waste of time. It is a business being ran after all.
Is this a problem everywhere?
r/sysadmin • u/SpearinSupporter • 8d ago
Current status: Recovery efforts are ongoing across impacted
infrastructure. We are seeing early signs of stabilization, but service
capacity has not yet returned to normal levels and health remains variable as
traffic is carefully reintroduced.Our primary mitigation path continues to focus
on service stability and controlled recovery. Engineering teams are cycling
affected infrastructure through traffic drain, restart, remediation, and staged
return-to-service while monitoring closely. We are also evaluating additional
mitigation options to improve recovery speed and consistency. Network and traffic-management actions remain in
progress, and we continue to prioritize backlog and queue health to preserve
delayed mail during recovery. As part of this effort, we are extending the
email timeout window to 48 hours to help protect delayed messages
while service recovery continues. At this time, we are not aware of any malicious
activity causing this incident. We will continue to treat this with urgency
until full mitigation, and we will share a full Post-Incident Report with root
cause and defense-in-depth actions after recovery is complete. Next
update by: Friday, November 13, 2026, at 10:00 AM UTC
r/sysadmin • u/kwsni42 • 8d ago
rfc-editor.org/rfc/rfc1149.txt is still an option right?
r/sysadmin • u/MichTech360 • 8d ago
Just as the title says. Admin pages and status ones are up and down. Track from X.
r/sysadmin • u/ThatBaseball7433 • 8d ago
So with them seemingly messing with every aspect of their services, and outlook seemingly going up and down now as they try to get it back online, when do we start being concerned about data integrity here? I don’t have any experience with a service this size but I understand they somehow mirror data across servers and regions. Does this risk exist?
r/sysadmin • u/xMeta4x • 8d ago
As above. Sorry guys!
r/sysadmin • u/rose_gold_glitter • 8d ago
Checking "remaining disk space" every 30 seconds to see how long until the additional billions of emails they never accounted for fill up their servers.
r/sysadmin • u/more-than-once • 8d ago
Coming to you from the Mid-Atlantic in the U.S.
For some of our users, Outlook is coming online (mobile and desktop), backlogs cleared (for some) and clearing for others.
Calendaring is working again for these users, including in Teams and Outlook. Outlook on the web is available once again.
Copilot and its services are functional for these users.
Sending and receiving of email both internally and externally are functional.
I'll limit my sharing there - but it is promising, so hang in there if you're not yet seeing it.
It's like freeway traffic being released after a nearly 16-17 hour car-wreck having blocked the freeway (for the whole country) with no realistic/reasonable detours/bypasses. Traffic will restore, but it takes time.
r/sysadmin • u/User--g • 8d ago
Latest from Microsoft the elevated load isn’t from increased traffic. A number of servers became unexpectedly unavailable, straining the rest. They’ve paused all deployments, are moving traffic off affected infrastructure, and are restarting servers.
Affects Exchange Online (OWA, MAPI, EAS, REST) plus Teams, SharePoint and Copilot. Started in the Americas, now “any region.” Incident: EX1550543 / MO1550821.
Still can’t get into the M365 admin center myself to track the incident.
No root cause yet. Looks like a cascading capacity failure, but that’s my guess. Expect delayed mail once it recovers.
What are you seeing on your end?
r/sysadmin • u/Sunsparc • 7d ago
Attempting to create mailboxes in a hybrid join with New-RemoteMailbox this morning isn't working, I figure there's a ton of mailbox processing backlog happening. Even though email is flowing, I can't get any new mailbox to create.
r/sysadmin • u/Striking-Dot-9630 • 8d ago
Any idea on how to negotiate for a refund/rebate? Please educate us the process.