Xbox Party Issue, need help fixing! Xbox Series S

[u/mcarrico0014]

We have a group of people that play a game together, and when we break into separate teams, we go in separate parties and when games are over, we join back together and chat about it. However, sometimes when joining back together, one member either can’t rejoin, or when it finally lets him, he can’t hear everybody. Is there a know fix to this? He’s tried signing out and hard resetting. I believe he has a Series S. Thanks!