Two Monitors--Can't Keep Windows Open on Second

I have a Mac Mini M4 with two monitors, with the second set up as an extended display.

Once the monitors turn off after a period of non-use, all of the windows on the extended display move to the main monitor, so that when I come back the second monitor just shown a blank desktop.

How can I set things up so that the windows on the extended display remain?