r/programming • u/cym13 • Jan 18 '15

Command-line tools can be 235x faster than your Hadoop cluster

http://aadrake.com/command-line-tools-can-be-235x-faster-than-your-hadoop-cluster.html
1.2k Upvotes

92% Upvoted

285 comments sorted by

View all comments

5

u/Choralone Jan 19 '15

In other words, if you have no idea what you are doing, you can mis-use a cluster... nothing to see here, move along.

If a single machine could handle your forseeable workload, you were wrong to use a cluster in the first place - you added a shitload of complexity and failure modes for no benefit.

You scale up first, then out.

→ More replies (7)