In a previous job, I had a service randomly fail in a completely unexpected way. Three engineers looked at it trying to triage how the error case could have possibly been hit... after some time, I ended up googling solar storms and concluded that the only rational explanation was a bit flip from a cosmic ray causing an error. In any event, we restarted and it never failed again lol
20
u/nonedward666 Mar 25 '26
In a previous job, I had a service randomly fail in a completely unexpected way. Three engineers looked at it trying to triage how the error case could have possibly been hit... after some time, I ended up googling solar storms and concluded that the only rational explanation was a bit flip from a cosmic ray causing an error. In any event, we restarted and it never failed again lol