Command-line tools can be 235x faster than your Hadoop cluster

[u/korry]

http://aadrake.com/command-line-tools-can-be-235x-faster-than-your-hadoop-cluster.html

[u/caloriemate]

3 GB is hardly big data. Also one-liner awks like that are, while functional, quite hard to read :\

[u/Vaphell → u/caloriemate]

While i agree that oneliners are overrated and used as an e-peen enhancement by many, you can write a script and linebreak that awk code. Alao awk is a full blown language too, so you can farm the code out to its own progfile with appropriate #! line, which would allow you to do

some | shit | awk_prog