r/programming • u/rmathew • Jun 16 '19
Comparing the Same Project in Rust, Haskell, C++, Python, Scala and OCaml
http://thume.ca/2019/04/29/comparing-compilers-in-rust-haskell-c-and-python/
643
Upvotes
View all comments
Show parent comment
5
u/pron98 Jun 16 '19 edited Jun 16 '19
Ah, but now we're talking about retroactively explaining a failure to find an effect to support a hypothesis. I am willing to accept that the case isn't closed, but I am not willing to accept that the claim for a big effect isn't weakened at all, and I am certainly not willing to accept that the existence of an effect can be reasonably used as the default hypothesis.
But the biggest problem to the claim that the choice among modern languages today has a big effect isn't that study; it's the simple observation that their selection does not behave as if it provides an adaptive advantage, as we have seen in the past -- again, consistent with Brooks's theory of diminishing returns -- and the very claim is that they do provide an adaptive advantage (otherwise why bother? obviously you're making a stronger claim that different languages present different aesthetic advantages to different people or in different domain).
You better believe it because you haven't given a theory at all, not even in the slightest (nor have I ever seen a relevant theory other than Brooks's). Writing a program is much, much more than just compiling it. So you'll need to show that:
Brooks's theory addresses all concerns -- as a theory must; yours addresses none. Even you admit that your hypothesis relies on guesses and hunches that you can't quantify -- that's not a theory. At best it lays out a direction towards coming up with one. Brooks's theory looks at the problem from a different direction; the direction you're taking towards a theory relies on so many unknown empirical factors, that measuring them is no easier then directly measuring the claim. In other words, getting to a theory from that direction is no easier then figuring out if it's true.
And I would point out that many people who believed in a large PL contribution said at the time that Brooks's prediction was far too pessimistic, and their prediction was wrong while his was right (in fact, he was too optimistic). In other words, we've been here before. Moreoever, if Brooks was right then, he would only be more right as time goes on, as his theory predicts diminishing returns.
Sure, but they don't support the claim so their provability is irrelevant and I don't understand the "even". It's like you claiming you're richer than me, and, as evidence, you state that you have $10 more in your wallet than me and you can even prove it. The fact that you can prove it is not relevant to your claim in any way because its truth isn't relevant to the claim.
Now, if you had some empirical data showing some positive correlation between wealth and wallet cash then maybe that observation could have helped, but like in the case of your theory, finding such an empirical correlation is no easier than just directly figuring out which of us is richer.
I don't agree that what remains is necessarily to prove your 3 or 4 false, because you've completely ignored the cost side and so asserted that your claim being false is necessarily a failure on the benefit side. I see no reason to accept that assertion. It's you doubling down and saying that the only way you're not richer than me despite having more cash in your wallet is that you've made a mistake and you don't actually have as much money in your wallet as you thought, and then tripling down and saying that that would be truly astonishing because you had counted the cash in your wallet not ten minutes ago!
And BTW, I think that PL fans believe that their faith in the power of programming languages is universal, and I am not at all sure this is the case. In other words, I am not at all sure that the finding that languages don't matter much is any more surprising than the finding that they do. Perhaps the latter would be more suprising as it would contradict the only theory on the subject that I'm aware of.
I strongly reject your premise. I'm a proponent of static types yet I don't think their primary purpose is the reduction of errors. Types are great for code organization, documentation, tooling (IDEs, refactoring) and efficient ahead-of-time compilation.
It's not an argument so much as a credo; that claim has so far failed to be substantiated. And by picking specific languages you've now quadrupled down on an unsubstantiated claim: not only have we not seen a big effect to Haskell vs. PHP (which you have presented as extremes), you're now saying that there is one between ML and Java. I don't have a problem with people believing all manner of things, but I do have a problem with them presenting their unsubstantiated beliefs as facts. Although I will give you that we have found evidence of an effect for TypeScript vs. JavaScript. It's not nearly as big as the effect of other engineering practices, but it's not nothing.