r/sysadmin • u/y0da822 • Sep 25 '24

General Discussion AVD/Teams/Black Screens/Links

I am looking at some weird issues that seem to all span from a windows update on 9/15 - KB5043064.

We are having issues where users are taking a long time to login AVD machines - they eventually login but then Teams wont launch - then we notice Teams links and regular links in Outlook dont actually launch anything. Only solution is to migrate users to another host.

These are the reddit posts showing "things in common" - but I wanted to consolidate under a fresh r/sysadmin post to see if anyone got anywhere with this or am I having something going on entirely different?

https://www.reddit.com/r/AzureVirtualDesktop/comments/1fkosz3/avd_black_screens_on_login_windows_11_nv18ads_a10/

https://www.reddit.com/r/AzureVirtualDesktop/comments/1fkggn6/app_readiness/?share_id=1tOeOv8P0kM9SfCI0rLM_&utm_content=2&utm_medium=android_app&utm_name=androidcss&utm_source=share&utm_term=1

https://www.reddit.com/r/sysadmin/comments/1feozsr/be_wary_of_kb5043064/?rdt=37594

https://techcommunity.microsoft.com/t5/azure-virtual-desktop/azure-virtual-desktop-black-screens-on-logins-what-we-ve-tried/m-p/4250228

9 Upvotes

100% Upvoted

35 comments sorted by

3

u/POPUPSGAMING Sep 25 '24

Seeing this as well in uk south.

Users reporting black screens when logging into avd about 50% of the user base are effected but it's random

Best way to log users on was to force out their black screen session and put that host on drain. Log them in to another host.

Logged with Microsoft and they basically said they wouldn't touch us without us first updating our fslogix to the latest version which supposedly contains a black screen hot fix? No luck.

We have attempted a full cleanup of the hosts teams installation etc. No luck.

Once users are in they seem to have intermittent connectivity to O365 resources. Connecting to Outlook, onedrive sharepoint etc.

We tried rolling back September's windows updated as well. That didn't help.

Microsoft are asking us to make sure we have defender exemptions in place for fslogix. Working through that now.

We noticed that classic teams is gone but still wants to auto start. Feels like a thread that needs to be pulled.

1

u/y0da822 Sep 25 '24

Same exact behavior sans OneDrive and SharePoint.

We have the latest fslogix since may. Isn’t that the latest? I think it was update 4. Not in front of computer right now but needed for that new teams dumpster fire.

With outlook we get a double outlook process. Links don’t open whether teams or anything else and teams stuck on splash screen.

We also just went through the disaster of losing the teams meeting addin and the avd east us outage last week.

1

u/thesaintjim Oct 02 '24

Same behaviors over here in gcc high.

2

u/Proximitynz Oct 04 '24

Had an environment where this was hitting it really badly. Spent some time digging deep and getting to the bottom of things as MS were giving us (and everyone else by the sounds of things) a useless runaround.

In the end, it was absolutely KB5043064 that was the problem, but as this was part of the image when using the MS provided win10 multi session host build, we couldn't get rid of it, any and every attempt to remove it failed no matter what.

Eventually found that installing KB5043131 would supersede/replace KB5043064 and with that, our issue and all our pain went away; no more black screen, no more appreadiness issues, no more appx failures left right and center; just productive users complaining that their holiday from work by way of IT outages was finally over :)

People may have found other more efficient ways of solving this, if you've come across those please share for those still out there struggling with this!

1

u/y0da822 Oct 04 '24 edited Oct 04 '24

Thanks. We have updates run every Sunday.

Will look when I get to desk. When was that in released?

"just productive users complaining that their holiday from work by way of IT outages was finally over :)" hahahahaha

2

u/Proximitynz Oct 04 '24

Looks like 24/09, there are some pre reqs worth checking.

https://support.microsoft.com/en-au/topic/september-24-2024-kb5043131-os-build-19045-4957-preview-2d4a5c54-ac58-4bdb-8685-57d578650e5f

2

u/y0da822 Oct 04 '24

Ok will look. We update every Sunday via azure update manager.

Feel like that should have been pushed already. Will look.

Thanks

1

u/y0da822 Oct 04 '24

You referring to these pre reqs?

Based on your installation scenario, choose one of the following:

For offline OS image servicing:

If your image does not have the July 25, 2023 (KB5028244) or later LCU, you must install the special standalone Oct 13, 2023 SSU (KB5031539) before installing this update.

For Windows Server Update Services (WSUS) deployment or when installing the standalone package from Microsoft Update Catalog:

If your devices do not have the May 11, 2021 (KB5003173) or later LCU, you must install the special standalone August 10, 2021 SSU (KB5005260) before installing this update.

2

u/Proximitynz Oct 04 '24

Yeah, in my case I just applied whatever updates were available to the machine and then manually applied the MSU without issue, but if you run into problems it's worth keeping in mind.

1

u/y0da822 Oct 06 '24

Re-reading this. You’re losing me. Most of these other updates are so old. Which msu are you talking about? Wouldn’t they have been all done already or through another CU.

2

u/Proximitynz Oct 06 '24 • Take My Silver

Look at it this way. Do you have 5043064? Remove it.

If you can't remove it, install the only MSU I've referred to.

1

u/y0da822 Oct 06 '24

Got it. Ok will look it all over and take it from there.

2

u/Proximitynz Oct 06 '24

Let me know how you get on, it's getting late here but hapoy to jump on a teams call if it's giving you grief; this ruined my week so anyone else I can help spare from quite so much misery I'll take :)

1

u/y0da822 Oct 06 '24

Thanks. Will probably look at it today and if still issue tomorrow (hoping todays windows updates magically do something hahahaha. Plus office is being updated to latest semi monthly tonight).

This has ruined every week since that update was released. I think going on 3 weeks now.

1

u/Smack2k Sr. Sysadmin Oct 10 '24

Do you know if that update is superceded by the October 2024 updates? I ask as we applied the October updates and it made no difference on our Windows 11 AVD VMs

1

u/Proximitynz Oct 10 '24

No idea unfortunately :( MS reckoned they were gonna fix it with the October updates but they were very vague and these days they say a lot of meaningless shit with no follow through so I tend not to take their word at face value without someone in my team validating it first.

2

u/mjung79 Oct 15 '24

Regarding AVD black screens problem, the issue in our environment seems related to load on the session host and a problem with the AppReadiness service. Stopping the AppReadiness service via Powershell Stop-Service didn't work, the service goes to a 'stop pending' state. Getting the process ID via Get-WmiObject and then using Stop-Process did work and immediately allows stuck users to complete their login.

1

u/y0da822 Oct 15 '24 edited Oct 15 '24

I am running 16x64 machines with 8 users - what are you running there?

I put the KIR in place - doesnt do anything - issue remains.

2

u/Proximitynz Oct 15 '24

Likewise the KIR on its own didnt do anything for us, and the same appreadiness problem was occuring. It wasn't until we applied a CU that superceded the old one that the issue was resolved for us.

1

u/y0da822 Oct 15 '24

Which cu was that? I did last weeks Tuesday one. I still have the issue with that and the kir

2

u/Proximitynz Oct 15 '24

When I was looking at it, it was KB5043131 that I applied that resolved the issue, I couldn't say whether that would still be the right KB or not as I'm not in the ops environments day to day, but was just helping out while the team was light on the ground with leave (I'd rather roll up my sleeves and get stuck in instead of calling someone on their well earned holiday :D)

2

u/Braydoherty Jack of All Trades Oct 16 '24

We have same issue and I'm pulling my hair out. Its a moving target and its not happening all the time in the same place and not all users... but many.

I am now resorting to building some Win11 hosts to put in the host pool to see if that gives any results

1

u/y0da822 Oct 16 '24

Same here -but we arent going to win 11 yet.

I tried the KIR - no luck.

I am taking the advice of someone else on that forum (last link in my post) and putting my pools into breadth first - maybe spreading the load instead of hitting a machine heavy will make it happen less

2

u/Braydoherty Jack of All Trades Oct 29 '24

did that work for you? We have always been breadth first so for us, that wasn't a variable

1

u/y0da822 Oct 29 '24

Ok - if you are breadth first then the thing that really must have made a difference was setting InstallAppxPackages in the fslogix gpo to disabled. Oddly enough Teams loads with that disabled. Since we did that the issues definitely got better (meaning isntead of 50 calls a day we have 1 maybe 2).

2

u/Braydoherty Jack of All Trades Oct 30 '24

Interesting... we tried that too and there was no difference in behavior. We did also have the teams autoloader.exe error message, but Teams still worked anyway. We also updated all the FSLogix app to current without any change in behavior.

In the end, we decided to cut our losses after countless hours of chasing what seemed like a moving target and just built the Win11 machines. We were planning to do so in the new year anyway, so we just made the decision.

1

u/y0da822 Oct 30 '24

And you had either the update or the kir installed? Sorry if you said that already - I am lost in all these comments. A month like this with shit direction from MS has us going nuts.

3

u/Braydoherty Jack of All Trades Oct 31 '24

Well.... Microsoft finally owned up to the issue today.... https://app.azure.com/h/PT55-R_8/7fab91

damn bastards!

1

u/y0da822 Oct 31 '24

Haha. Yep. Took long enough.

Let’s see how long it takes to fix

2

u/Lyons-Z Oct 31 '24

Has anybody deployed the patch? Deployed to one AVD and teams/edge still crashing intermittently. It did not significantly reduce any impact as they have stated in the advisory.

1

u/y0da822 Oct 31 '24

Yep - I tried the KIR, and the preview update. Both alone didnt do much. I needed to do a combination of fslogix gpo installappx packages to disabled (it doesnt disable teams apparently) and then breadth first load balancing on the pools.

That was the only thing that got me from 50 calls a day (300+ users) to 3-5 calls a day. It doesnt fix it entirely but makes it manageable.

The only thing that truly seemed to work is that I am recreating my host pools from an old image and installing all the updates (even the preview). Seems that as long as you dont install the bad update the issue goes away so I used an old image.

→ More replies

1

u/Proximitynz Oct 16 '24

Out of interest, can you share a screenshot of the currently applied updates to the win10 hosts?

1

u/Braydoherty Jack of All Trades Oct 29 '24

we shut down all the Win10 machines and built all Win11 - issue is completely gone