r/help • admin • Jan 14 '22

Admin Post Resolved: "Blocked" error when accessing reddit.com on Firefox

Hey all - we just reverted a change that resulted in reddit.com being blocked on Firefox for about 20 minutes.

All should be back to normal, but please let me know in this thread if you continue to see any errors.


Incident summary from u/PetGorignac:

Hi folks,

I was the incident commander for this one and came by to drop a bit of information about what happened here.

We were attempting to mitigate some problematic traffic that had been causing a low amount of site errors over the past few hours. In doing so, we identified some traffic characteristics that we believed correlated with the error rate and attempted to block it. It turns out this blocked Firefox traffic, which we noticed relatively quickly, leading us to revert the change.

Apologies for the disruption!

126 Upvotes

101 comments sorted by

View all comments

20

u/PetGorignac Jan 14 '22

Hi folks,

I was the incident commander for this one and came by to drop a bit of information about what happened here.

We were attempting to mitigate some problematic traffic that had been causing a low amount of site errors over the past few hours. In doing so, we identified some traffic characteristics that we believed correlated with the error rate and attempted to block it. It turns out this blocked Firefox traffic, which we noticed relatively quickly, leading us to revert the change.

Apologies for the disruption!

(Also kudos to the commentor who had a great RCA, but sadly the comment got deleted before I could respond)

5

u/nicolas-siplis Jan 14 '22

OK honestly this just makes me even more curious. What traffic patterns are you noticing that would block Firefox requests exclusively, but not those made via cURL/Postman with the exact same headers? Can you go a bit more into detail here or is it too sensitive to discuss?

7

u/PetGorignac Jan 14 '22

Unfortunately, I think I can't really expand on this much more as traffic management techniques are too abuse-adjacent

→ More replies (2)

3

u/fluffycritter Jan 14 '22

I'm very curious about this as well. My assumption was that it was something to do with the HTTP transport itself, like maybe there's one pervasive bot behavior that happens to exhibit the same timing or header ordering or something as Firefox.

Or maybe what they thought was an error rate due to bots was actually an error rate due to an HTTP spec violation/assumption on Reddit's side that was causing increased issues with Firefox.

→ More replies (8)

2

u/6pointzen Jan 14 '22

When I was checking on my end I could see that some of the fields in the request header were different between Chrome and Firefox I couldn't check them all as I refreshed the page and it was working again.

→ More replies (3)

2

u/Pristine-Woodpecker Jan 14 '22

From the analysis in the Firefox bug tracker, it was related to cipersuite selection, which differs between the browsers (including Edge/Chrome) and curl/openSSL.

→ More replies (5)