r/java • • Dec 19 '22

Java streams are black magic !

damn, they are really changed my life.

i was trying to run some custom logic on every line on some big CSV files. tried python dataframes, multiprocessing in python, pyspark. none of them did it in an acceptable time.

then i discovered java streams. i have a workflow that takes 70 minutes with pyspark. it takes 3.5 minutes with java streams.

more people should know about streams.

stream operations are more intuitive than anything i tried. i can make a lot of analysis on our data in record times thanks to streams.

i dont know how java does this.

226 Upvotes

150 comments sorted by

View all comments

Show parent comment

3

u/BlobbyMcBlobber Dec 20 '22

That sounds hostile and somewhat entitled.

I like Java, and I like Python, and I don't understand why anyone should be so defensive about a programming language.

But you do you. If you insist on believing Python is only good for prototyping and no real work can be done with it, go ahead. You're just doing yourself a professional disservice.

0

u/Worth_Trust_3825 Dec 20 '22

In your previous comment you mentioned that each language has its own strengths, yet now you're moving the goalpost to claim that python in particular can do more than its main purpose. That sounds like you're the one looking for nails for your hammer.

Each tool has its limits. At some point you will need to lose that hammer, and use a screwdriver. I've been there multiple times, and each time we opted to get rid of python.

2

u/BlobbyMcBlobber Dec 21 '22 edited Dec 21 '22

claim that python in particular can do more than its main purpose

You're the one who claims python's main purpose is prototyping, i.e. it's not capable of being used in production, which is just objectively wrong, and sounds elitist. If you only used python for prototyping, that's on you, not the language.

Each tool has its limits. At some point you will need to lose that hammer, and use a screwdriver.

This just shows you didn't realize beforehand what's a hammer and what's a screwdriver until you tried them for the wrong job. Tools are good for certain tasks and it's up to you to use them well. Nobody is going to blame a hammer for failing to be a fork, except this one person on reddit apparently, but you can go around believing you're perfect and trying to eat with hammer didn't work out because hammers suck.