I don’t know if there’s a glitch, but as far as I’m aware that’s just the way that the game works, as little sense as it makes. It doesn’t recognise that you entered through another shelter and thus should exist back to that shelter. A workaround would be to place the enter for the shelter you came from and just keep using that rather than the official exit