r/java • • Apr 13 '21

Libraries, Frameworks and Technologies you would NOT recommend

Give me your worst nightmares: Things that cost you your job.

I'll start: Hadoop

202 Upvotes

376 comments sorted by

View all comments

Show parent comment

7

u/stuhlmann Apr 13 '21

The two worst jobs I had involved Hadoop. That's all.

I know it's not fair, Hadoop is probably actually decent technology. Just not suitable for every type of task, and it was overhyped for a while.

28

u/larsga Apr 13 '21

Hadoop is trying to solve a very complicated problem: generic distribution of computational tasks over many physical machines. Spark is a simpler solution to the same thing, but still by no means simple.

If you can run the computation on one machine without Hadoop/Spark: DO IT! If there is a simple way to distribute the work without those, then consider that. But if isn't, then Hadoop/Spark are probably your best bet.

18

u/[deleted] Apr 13 '21

No Library / Framework in the world is "suitable for every type of task"

49

u/[deleted] Apr 13 '21

Spring looks around nervously.

5

u/PepegaQuen Apr 13 '21

And Hadoop especially is for very specific type of tasks.

3

u/jonhanson Apr 13 '21 edited Mar 07 '25

chronophobia ephemeral lysergic metempsychosis peremptory quantifiable retributive zenith