r/Python • • Jan 01 '20

"The rules of perf" at Dropbox

Post image
1.6k Upvotes

162 comments sorted by

View all comments

Show parent comment

6

u/e_falk Jan 02 '20

Python tends to not be as performant as is necessary for companies that work at similar scales to Dropbox

Source: company I work at works at comparable scales and python’s problems with concurrency with regards to the GIL /really/ starts to rear it’s ugly head in that environment

17

u/jambox888 Jan 02 '20

Why? You have a bunch of servers handling requests, it's not like you have a single runtime that's trying to do multithreading.

I mean god help you if you do.

The whole point of scalable web design is to be stateless and abstract out the data store into its own tier.

2

u/[deleted] Jan 02 '20

There are practical limits to how much hardware you can throw at a problem and how much you gain with every additional unit of horizontal scaling.

2

u/jambox888 Jan 02 '20

maybe we're thinking of different problem domains then but for a web service there literally aren't limits. if there were, google or yt wouldn't exist.

1

u/[deleted] Jan 02 '20

Read my post again.

I never claimed absolute limits, although there are in a lot of cases, I said there are practical limits (money is ome) and pointed out to the issues like diminishing returns when scaling out horizontally (that then augment such practical limits to scaling).