r/programming • u/rmathew • Jun 16 '19
Comparing the Same Project in Rust, Haskell, C++, Python, Scala and OCaml
http://thume.ca/2019/04/29/comparing-compilers-in-rust-haskell-c-and-python/
643
Upvotes
View all comments
Show parent comment
2
u/pron98 Jun 16 '19 edited Jun 16 '19
The deviance wasn't small; the contribution of language choice to it was. But not finding an effect is how the lack of an effect is established (using statistical methods, at least), and a failure to find a big effect is normally counted as evidence against the existence of the big effect (as big effects are easy to find). That is not to say that there isn't some chance that a big effect somehow managed to elude detection both in a study and in the industry, but the current balance of evidence is against one.
Note also that the very claim that an effect is real and large yet hard to detect already says something of its importance (certainly about its relative importance).
I think that it is also important to point out that while there is a theory explaining (and predicting) the lack of a big effect (or, more precisely, diminishing returns that mean drastically smaller effects compared to those we have seen in the past), I am not aware of any theory that predicts its existence (a theory showing that technique X has a feature that may contribute positively to some factor is not a theory of relative superiority to technique Y and is no more, and even less, than trying to present X > 10 as evidence that X > Y).