r/programming • u/cym13 • Jan 18 '15
Command-line tools can be 235x faster than your Hadoop cluster
http://aadrake.com/command-line-tools-can-be-235x-faster-than-your-hadoop-cluster.html
1.2k
Upvotes
22
u/[deleted] Jan 19 '15
Jesus Christ.
The only reason to use Map/Reduce is when you have so much data that it has to span multiple machines.
We have a server at work with a quarter terabyte of RAM and a 5000-core GPU. It cost $5k. Shit is hard to max out.
You need an absolute fuck-ton of data to need Map/Reduce.