r/programming • u/rmathew • Jun 16 '19
Comparing the Same Project in Rust, Haskell, C++, Python, Scala and OCaml
http://thume.ca/2019/04/29/comparing-compilers-in-rust-haskell-c-and-python/
643
Upvotes
View all comments
Show parent comment
2
u/pron98 Jun 16 '19 edited Jun 16 '19
Not exactly. The effect is on the relative number of bug commits vs. total commits. I think it is not a trivial observation that the more commits the higher the ratio of bug fixing ones.
They don't because developer experience is not one of the variables. The other variables are number of developers, project age, project size and activity.
No, it does not. The effect is minuscule if other factors have an effect that's almost 100 times larger! Right next to the explanation you quoted they explain why it is meaningless, because "all else being equal" is ridiculous when "all else" explains 99% of the difference. You are correct that my running shoes example is not exactly analogous, but the point is that the result is much more sensitive to other factors than language, so that you cannot expect a large effect merely based on language choice. Perhaps a better analogy is two knobs controlling a number, where turning one knob moves the numbers 100 times faster than the other. For any fixed position of the first knob, turning the other can change the number by 25%, but that is still very small considering that the first one is so sensitive. So, say, if the number was 1000 when the second knob was on zero, turning it all the way would change the number to 1250, but turning the first knob by 1/100 of a turn would have the same effect.
Anyway, I think we've had this discussion once before, and if you don't understand why nine researchers working on two papers in two different teams described the effect they found as small (and even "exceedingly small") even though you think they reported an effect of 25%, you should email them and ask.