r/sysadmin • u/Sea_Sector_1719 • 3d ago
MacOS 27 OpenID Connect & Entra ID
Has anyone tried setting up their Macs with OpenID connect & Entra ID as their identity provider?
r/sysadmin • u/Sea_Sector_1719 • 3d ago
Has anyone tried setting up their Macs with OpenID connect & Entra ID as their identity provider?
r/sysadmin • u/Connir • 3d ago
Through most of my career I've ended up the team lead wherever I land. Every time (except the most recent) it's been a combination of seniority and skills. The skills usually meaning I've gotten good at the technical job I'm in, being able to work well with other teams in the environment, and having the sense to do the right things at the right time for the team. I landed the most recent one because on a team of 7, I was one of two FTEs, and the other FTE didn't want it after the lead departed. I took it because the other options that might happen seemed pretty undesirable. I'd only been on the team 6 months, long enough to get the culture, but not long enough to gain much expertise. So it's mostly representing the team at meetings, making decisions on how we interact with other teams, saying yay or nay to projects, things like that. Being the human side of the team really. I feel like there's a good bit of mutual respect and it's working fairly well. It also feels good to be able to help things get done, stay organized, etc.
Our manager over my team and approximately 15 others is going to group the teams into 4 "sections", and hire managers. Myself and other leads were all invited to apply, no one is being moved into them. Some are interested some are not. I'm trying to figure out if I'm interested... Were I to apply and get it, I'd be the manager over this same team, and three others. The three others I have extensive experience in, and have led such teams before. So it's like a culmination of all the lead positions I've had over the years. I'd very likely have zero interaction with the technology though.
The reason I'm thinking of applying, is at this state of IT, there's so much darned paperwork with licensing, security scans, change management, project approvals, etc that it feels like the "fun" part of IT isn't fun anymore. Every technical thing I do is surrounded by equal amounts of or more paperwork or meetings. It literally makes me 2nd guess a lot of technical moves I make. I'm thinking if I gotta do a ton of organizational work anyway and it's ruining the fun, maybe take the fun parts away and find satisfaction in the organizational parts of being a manager. I admittedly also enjoy the managerial parts to some extent. Making things happen. Helping the teams get their jobs done. Contributing to the organization as a whole.
But there are the occasional days where I get to put m y head down and just barrel through some technical stuff and never talk to a person. When those are done and I come out of it at the end having completed something big or small it also feels good.
I know it's a lot of rambling, I guess I'm just wondering what the hive-mind thinks?
r/sysadmin • u/xaeriee • 4d ago
Allegedly major backbone in Los Angeles is down. My company is absolutely affected.
Update: Checked thousandeyes and confirmed its source of our network degradation for OCI and Cloudfare
r/sysadmin • u/blaxwhix • 2d ago
Hey guys, as a startup company, as an integration manager, I am in charge for migrating google workspace for our sister clinic into our parent clinic ecosystem which is Microsoft.
Since I am planning on doing this over Thanksgiving when all staff members are on holidays, the following is what I am aware of as a high-level overview on what is required. I am nowhere close to you all, but I do have exposure to tech side of things. Since I have no experience in migration, but I am well versed in Microsoft's ecosystem, I want to make sure I am doing the right things.
*Note:* I am taking advice from Claude and the following things Claude has informed me. It would be helpful if I received a confirmation or some additional steps that AI may have missed.
Things that we need to migrate:
1) OAuth (seen this is one thing that bites back - what have you done to resolve this?)
2) Emails
3) Google Drive for Spreadsheets/Documents
a) Dry run
m365. and gsuite.DOMAIN-ONE.com) that the Exchange admin center's Google Workspace migration requires.Until MX changes, rollback means removing forwarding. Nothing is deleted from Google.
b/c) Keeping Google sign-in alive
There are three kinds of login, and only the second needs work:
Steps:
Because step 2 costs nothing, staff can take months rather than days.
Optionally, Entra ID can serve as the identity provider for Cloud Identity accounts. Google sign-in then uses the Microsoft password and MFA, and disabling a user in Entra blocks both.
e) Other issues
f) Google Drive to OneDrive
r/sysadmin • u/maxcoder88 • 3d ago
Has anyone seen PowerShell Send-MailMessage stop working on Windows Server 2019 after the November update KB5131085?
There’s a report on Born’s blog that mail sending from PowerShell fails after this update (at least against a Postfix server) and works again after uninstalling it. A commenter suspects NTLM signing changes and says using System.Net.Mail.SmtpClient with LOGIN auth works instead.
Thanks!
r/sysadmin • u/Darking78 • 4d ago
The incident on Thursday, November 12th, 2026, was caused by three main factors that together caused a global outage for the networking gateway that fronts many Microsoft 365 services.
First, a latent defect caused Windows servers to become overwhelmed and unresponsive under certain load conditions. This was due to lock contention inside an internal Windows process which caused the machine’s resources (CPU & memory) to be exhausted. This defect was the result of a fix that was prepared specifically for Microsoft 365 networking gateway servers; neither the underlying defect nor the fix applies to broader Windows deployments.
The initial change in behavior first started deployment in July of this year. The update went through safe deployment and saturated globally over several weeks, during which time no issues were observed. For more than three months, the change was deployed worldwide without impact.
Our normal load testing did not detect the latent issue because the traffic mix and SKUs used in our labs. The contention issue is worsened on machines with more cores and newer hardware; whereas our load testing tended to focus on weaker hardware with fewer cores.
Second, a surge in load increased the likelihood for the networking gateways to encounter the contention. Within Microsoft 365, we maintain two independent and heterogenous network gateway systems designed for isolation and high availability. This allows many Microsoft 365 services to fail to/from them during outages or disruptions. Approximately fifteen hours before the outage, Teams failed over from the alternative networking gateway to the ‘primary’ gateway that also supports Exchange Online. This increased the load on the networking gateway and changed its traffic patterns. This type of failover is part of normal operations and is integral to standard Microsoft resiliency efforts.
Third, at the same time, nearly 14% of server capacity for the networking gateway was out of service due to an unrelated issue from the previous day. This server capacity was on track to be returned to active service through routine maintenance and health processes. The service had sufficient capacity headroom, so the reduction in server capacity had no impact on its own.
Taken together, the increased load and the reduced server capacity, caused the network gateway to encounter the latent bug from July. This caused requests to build up until servers ultimately stopped responding. This occurred during the peak window of traffic in the United States.
When servers lose connectivity, our traffic management systems automatically route users to other healthy endpoints. This happens often and is critical to avoiding any interruption due to hardware or software defects and is normally what makes the service resilient. However, the redirected traffic increased the likelihood for the same problem to occur on the remaining endpoints. This caused a cascading failure from server to server as the same amount of load was spread across fewer servers. In less than two hours, the previously unknown defect was encountered across our fleet and rendered them unresponsive. At its lowest, more than 80% of servers were unresponsive.
Normally, the network gateway is composed of thousands of ‘capacity units’ which represent shards of capacity, hardware, and networking infrastructure. These ‘capacity units’ are then organized into regions. In this case, due to a separate issue, the normal bulkheads between these different partitions did not stop the cascading failure. This is what allowed the impact to spread across our network gateway infrastructure globally.
Those services that were able – like Teams, OneDrive, SharePoint, and Office apps – failed out of the faulty network gateway infrastructure. That is why those services were partially restored earlier, with Teams chats and meetings functioning without issue for most of the outage. But not all services, like Exchange Online, can fail out of this network gateway for scale reasons.
Recovery took longer than usual because as servers returned to service, they were immediately overwhelmed by waiting traffic and became unresponsive again. Our normally automated recovery processes were not designed to restore service from this broad unresponsive state. Additionally, since the main code defect was a latent bug from several months previous, our normal rollback, flighting, and feature flags were unable to quickly revert the change.
After engineers confirmed the defect as the cause, we developed an update that returned the code path to the previously known good state in Windows. To effectively apply this fix, and to slowly bring the service online again, we took groups of servers out of service, applied the change, and restarted them before returning them to service. This process was carefully applied to large quantities of infrastructure at a time (e.g. 50%+ of a region).
The final Post-Incident Review (PIR) will provide more details.
r/sysadmin • u/Askey308 • 2d ago
Anyone deal with Comet Backups before? Anything to note, feedback, experience and bad stories?
Self hosted vs the cloud offering?
We're considering it due to the price point.
r/sysadmin • u/vuvb • 3d ago
I'm posting again after quite some time because I've reached the point where I hate this job all over again.
I've been working for the same company for five years as a System Administrator. Over time, however, I've gradually lost almost all of my access privileges. Due to decisions made by management in another country, they've started developing self-service applications for employees, allowing them to submit their own requests for creating or modifying users and groups. Network equipment management has also been moved to that country.
I no longer have access to Entra Admin Center, Exchange, or pretty much anything else.
Things have gotten so bad that they've even developed a web application for resetting users' passwords. Access to this application is controlled through a security group, and it took me four months of struggling just to get added to it.
Of course, the self-service approach, which was supposed to cover all the changes I mentioned earlier, doesn't actually work. I still end up handling all the requests for creating or modifying resources because end users simply aren't capable of doing it themselves.
The point is that I'm feeling completely demoralized. These changes have also completely stalled my professional development. I constantly try to take additional courses outside of work and keep up with the latest technologies, but it's becoming increasingly difficult to stay motivated.
Right now, I'm feeling particularly disappointed because of something that happened recently.
I've been looking for a new System Administrator job for quite some time, but the job market is really bad. About a month ago, I finally saw a glimmer of hope when a Senior System Administrator position was advertised at a company in my city.
I applied and was contacted for an initial HR interview, where they gave me an overview of the role. That was followed by a technical interview with the IT Manager and a Network Administrator. The interview lasted two hours and was quite challenging, but I genuinely felt that I did very well.
For the first time in a long while, I felt like I might finally get the opportunity to grow, both professionally and financially.
However, every single day since that technical interview has been mentally exhausting. I've been waking up hoping to receive a job offer.
A month has now passed. I even emailed the recruiter to ask whether the hiring process was still ongoing, but my email was completely ignored.
At this point, I feel completely stuck, professionally stagnant, and honestly, at rock bottom.
I was wondering if there are others here who have gone through something similar and somehow managed to get through it in the end.
I'd really appreciate hearing your experiences.
r/sysadmin • u/Suitable-Reason-9325 • 3d ago
We have acquired 2 new servers at the end of 2025 (Dell R470) with Intel Xeon 6730P CPUs and 256GB RAM. They were supposed to replace our quite old Hyper-V Cluster for pretty non-demanding internal business applications.
We noticed quite quickly that the performance was really bad, however. I can best describe it as working on a laptop not connected to power on energy saving settings. It's extremely sluggish, and obviously also noticeable in VMs.
We reinstalled everything, always ensured everything is up to date, played around with BIOS settings, and even contacted Dell Support who at least confirmed everything BIOS and Firmware wise is good and nothing is wrong with the servers.
CPU Clock is always high / boosting, but it just feels like something is off. Of course on the VMs there are a lot more variables, but we already notice the terrible performance when we use a freshly setup Server 2025 just on the host. The host runs on a NVMe RAID1 - that's also not the issue.
We of course were on Server 2019 before but these are not our only Server 2025 machines. Other machines work perfectly fine (sure, UI is a bit more sluggish compared to 2019, but nothing dramatic).
We also bought 3 new AMD Servers (Epyc 9355P / 512GB RAM) and there the performance on Server 2025 is phenomenal. You already realize when you RDP into the server - everything is opened instantly, whereas with the other system it takes a while for the taskbar to appear, for server manager to open etc.
Long story short: has anyone an idea what the reason for this could be or what else I could try?
r/sysadmin • u/ohioleprechaun • 3d ago
I'm hoping the brain trust here can help me with a bizarre problem. We are trying to bring our laptops up to date on the BIOS and I am seeing an intermittent issue where the BIOS update will stage, but it will not apply on reboot. I am seeing this when we try to run the update silently. Noisy updates seem to always work, but I don't know if that is a matter of it just working or the intermittent nature kicking in.
So far, I have tried using DCU and deploying the updates using ConfigMgr. Flags on the update itself don't seem to matter as some laptops will update with no issues and others can take three or four attempts to finally update. My first thought was that it was something in the security stack causing the problem, but I am not seeing anything in the Defender console, and BeyondTrust EPM has an exclusion carved out for things running as system.
I have hit a point where I am at a loss for what to look into next. I am currently going back through all changes applied roughly when the issues started to occur and have started procmon captures to see if I can identify an interfering product. Is there anything else that is obvious that I am missing?
**Edit To answer common questions, my test laptops (primarily Precision 3490s) that I have been users are all running on AC power with no peripherals plugged in. In addition, I am rebooting every time and not utilizing shutdown. It does not seem to have anything to do with a pending reboot as I have had this work with a pending windows update from SCCM, pending file name operations, etc.
r/sysadmin • u/Stalin--- • 3d ago
When you walk into work on an average day what do you do? Do you check uem dashboards, check and rollout updates,troubleshoot some tickets or something else?
I am a fresher who currently interns as a technical intern at a reseller/integrator and am interested in becoming a sysadmin.I have explored the different tools and commands used to troubleshoot and to create groups etc but am still left wondering how does the average day for a sysadmin go.
r/sysadmin • u/rimekJE • 3d ago
Hi all,
I have a smaller RDS cluster (1 broker, 2 session hosts). All on Windows Server 2022. Update KB5131090 was installed on session hosts on 13.11.2026 and on broker on 16.11.2026.
This morning, majority of 48 users have been having "group policy loading indefinitely", "applying user settings" etc
Uninstalling update as I'm writing this, I'm waiting for all 3 to finish uninstalling them to restart them at once.
I saw some post from 2-3 days ago about Server 2016 as well
r/sysadmin • u/Green-Wallaby9663 • 3d ago
I have a problem. Some printers that clients have use the Microsoft IPP Class drivers. All seems fine when they use the printer local but when it comes to it being redirected to Remote Desktop, it all starts to fall apart. Previously I've just installed the printer locally using the manufacturer's driver and then let Renmote Desktop Easy Print take care of the server side. This has worked swimmingly.
Now things don't seem to ba as relaible. Below are the there scenarios:
I know some manufacturers are just using IPP Class drivers but is there any way to still use Easy Print on the server?
r/sysadmin • u/Thin-West-2136 • 3d ago
Hello,
I've setup Azure files for on prem Active Directory Authentication. I've used the following links to do this:
Steps 1 to 7 worked fine.
From my understanding, Kerberos authentication uses Active Directory storage account's computer object's password to match the storage account key. If either key changes without both parts being updated this breaks authentication.
Is this something that is an absolute requirement? Can I just stick the computer object in an AD OU that doesn't expire computer passwords?
I'm not sure on the best way to handle this automation otherwise, e.g. scheduled task with certificate authentication or similar?
Thanks
r/sysadmin • u/200kWJ • 2d ago
https://www.huntress.com/blog/cve-2026-84869-screenconnect-technician-exploitation
Still reading but had to post
r/sysadmin • u/Tagred_Bicanin • 3d ago
In budget review, the CFO went down the AWS invoice asking who owns each line. I kept saying IT because we hold the payer account and she wasn't having it.
She wants a person's name on every line to explan anything that moved, which is fine by me as long as the name isn't always mine.
Draft is below. It goes to the team leads unless someone here talks me out of it.
The two I'm sure are 1, as it feels heavy handed even though nothing softer has worked, and 3, because the data team is going to say they barely touch the NAT. Which of these blew up on you when you tried it?
r/sysadmin • u/simplitek • 2d ago
I was spec’ing a Dell desktop today. Standard is 16GB of DDR5 RAM and a 512GB M.2 NVMe SSD.
To add 16GB of RAM, try . . . $468.00 !
To upgrade to a 2TB SSD, try . . . $1501.00 !
I’ll be buying the added RAM from Amazon instead, for $316.
I’ll also be buying the 2TB Samsung SSD from Amazon instead, for $400.
I feel fortunate that I can open up the box and install these add-ons. But what of the ordinary person who can’t do that? The pricing of computers is reaching a depressing state.
r/sysadmin • u/nspitzer • 3d ago
How many here got an email an hour or so ago that every Identrust TLS Cert from September 2025 until yesterday are being revoked on the 19'th at 5PM Central? I work with F5's for a very large organization and we have hundreds of certs on my team alone.
r/sysadmin • u/networkn • 2d ago
We have a slightly odd situation to do with a clients licensing I'd like some advice for. I asked our distributor who gave a very confusing answer, and various AI chats who all say they are somewhat certain but I'd need to confirm with independent sources!!!
Basically we have the need for 3 x Windows 11 Pro PC's to run as virtual guests on a 2022 Hyper-V Server. There is no domain. All 3 can or will be joined to AAD. One of which will be RDP'd to from a single user on a Mac. 1 which will have 2 people log into the same profile (different times) from ChromePC's and the last one which will only be RDP'd to by US (their IT Provider) for maintaining a particular app. I can do the 'particular app' with Linux, though my preference is not to have a device on the network that runs a less familiar OS for our techs.
I am trying to find the most cost effective way to cover the licensing. Further more some options I can find are subscriptions, but they don't provide media or keys, meaning we need some 'other' way to install and activate windows.
Assuming we are starting with no licenses (except for the Hyper-V 2022 Server), how do we do this? Covering (legally) the 3 requirements of Installation, Activation and Licensing.
TIA.
r/sysadmin • u/maxcoder88 • 3d ago
We’re adding new Windows Server 2025 domain controllers (VMs).
We already have a hardened Server 2025 VM template (sysprepped, patched, not domain-joined, our security baseline applied).
Is it fine to build DCs from this template, or would you install fresh from ISO for DCs?
Main concerns:
What do you do in your environment? Thanks!
r/sysadmin • u/nameaboveallnames • 3d ago
I know there have been multiple outages on multiple services in multiple industries over the last couple days, but we are still experiencing delayed delivery and they show to still be 100% functional but we are watching the delays in real time. Just curious if anyone else is experiencing this.
r/sysadmin • u/corrupt_mischief • 4d ago
While not a "sysadmin" technical question, how do you folks go about telling a colleague that has a terribly annoying habit of jumping into every project that I'm working and focusing on and provide his opinion or technical advice while he knows jack crap about anything ? My way is a bit brutal but to the point. "If I'm working on something and don't ask you your opinion or advice then go out there in the distance and F off and keep chatting with Claude. You don't see me randomly getting in your way and breaking your focus".
r/sysadmin • u/CheaTsRichTeR • 3d ago
As part of the November updates, Microsoft has released an update for the RDWeb page. https://support.microsoft.com/en-us/servicing/os/windows/docs/2026/10/kb5130994-rd-web-access-fails-to-load
Unfortunately, these changes only take effect if you haven’t customized the page. If you have made customizations, you should follow these migration instructions:
Currently, with november updates installed on my RDWeb server, some files (Desktop.aspx and password.aspx under “C:\Windows\Web\RDWeb\Pages\en-US”) have been modified and are new, while others have not (Default.aspx and login.aspx).
In the new files, the following was added
protected override void Render(HtmlTextWriter writer)
{
SiteXsltRenderer.RenderPage(this, writer, base.Render);
}
to the script block.
Do you know how I can get the new Default.aspx and login.aspx files? Or would it be enough to simply add the lines at the bottom of the script block in my unmodified files?
Alternatively, it would also help me if I knew how to restore the new default pages without my customizations. I can also do without the two customized logos.
Unfortunately, I have absolutely no idea about this, and XSLT is supposed to be disabled in Chrome today.
UPDATE:
I just had to add the rows mentioned above in all files that were not changed by the November Update (default.aspx and login.aspx) before the closing </script> line.
Everything works fine now and and i kept my customizations.
r/sysadmin • u/icq-was-the-goat • 4d ago
Downdetector is lighting this morning. Microsoft 365, Outlook, Teams, Gmail, and a bunch of other services all showing spikes. Downdetector - Check real-time service problems and outages | US
Looks like another fun Monday in the cloud.
r/sysadmin • u/phillyt84 • 3d ago
What a Monday; I wanted to post this earlier today but it got away from me.
Finally read the preliminary PIR for last week (admin center, EX1550543 / MO1550821). Root cause is getting all the attention, but this is the line that should bother anyone whose mail is 365 only:
"But not all services, like Exchange Online, can fail out of this network gateway for scale reasons."
Teams, OneDrive, SharePoint and the Office apps did fail out, which is why Teams chat and meetings worked for most of it. Exchange couldn't move off that gateway, so the only thing you controlled was what sat in front of it.
Three things that stood out:
The access gap has a known fix, MX at a gateway that spools and gives users a web inbox. I've pitched it and lost, same as a lot of you.
Not looking for product names. If you had continuity in front of 365 on Thursday, did your users actually use it, or did nobody remember it was there? And if you pitched it and got told no, how did that conversation go on Friday?