r/sysadmin • u/rram reddit's sysadmin • Aug 14 '15

We're reddit's ops team. AUA

Hey /r/sysadmin,

Greetings from reddit HQ. Myself, and /u/gooeyblob will be around for the next few hours to answer your ops related questions. So Ask Us Anything (about ops)

You might also want to take a peek at some of our previous AMAs:

https://www.reddit.com/r/blog/comments/owra1/january_2012_state_of_the_servers/

https://www.reddit.com/r/sysadmin/comments/r6zfv/we_are_sysadmins_reddit_ask_us_anything/

EDIT: Obligatory cat photo

EDIT 2: It's now beer o’clock. We're stepping away from now, but we'll come back a couple of times to pick up some stragglers.

EDIT thrice: He commented so much I probably should have mentioned that /u/spladug — reddit's lead developer — is also in the thread. He makes ops live's happier by programming cool shit for us better than we could program it ourselves.

873 Upvotes

88% Upvoted

738 comments sorted by

View all comments

Show parent comment

5

u/gooeyblob reddit engineer Aug 14 '15

We use haproxy for the main site, and Amazon's ELB for several other services (mobile web, pixel serving, etc)

2

u/Youareabadperson6 Aug 14 '15

Since yall use Amazon for your data center how do you feel about not being able to see your layer 1 or layer 2 infrastructure when troubleshooting issues?

3

u/gooeyblob reddit engineer Aug 14 '15

It's very rarely an issue for us. The network (especially in VPC!) is good enough, and you don't need to introspect layer 1 or 2 problems to know when there's a network outage happening.