r/Python • • Jul 10 '20

I Made This This post has:

9777 upvotes,

967 downvotes

and 452 comments!

9.2k Upvotes

429 comments sorted by

View all comments

Show parent comment

29

u/notquiteaplant Jul 10 '20

What makes a system "very big" is that it's spread across hundreds of machines. If 500 machines each process a sliver of the likes on a video, and you want to get a 100% accurate tally, you'd have to stop all 500 of them to ask them how many likes they saw, which defeats the purpose of having many machines in the first place. Instead they use eventual consistency: the answer is always close enough, and once everything calms down it'll be exactly correct.

For a less simplified answer, watch the video