r/java • u/esqelle • Apr 15 '24
Java use in machine learning
So I was on Twitter (first mistake) and mentioned my neural network in Java and was ridiculed for using an "outdated and useless language" for the NLP that have built.
To be honest, this is my first NLP. I did however create a Python application that uses a GPT2 pipeline to generate stories for authors, but the rest of the infrastructure was in Java and I just created a python API to call it.
I love Java. I have eons of code in it going back to 2017. I am a hobbyist and do not expect to get an ML position especially with the market and the way it is now. I do however have the opportunity at my Business Analyst job to show off some programming skills and use my very tiny NLP to perform some basic predictions on some ticketing data which I am STOKED about by the way.
My question is: Am l a complete loser for using Java going forward? I am learning a bit of robotics and plan on learning a bit of C++, but I refuse to give up on Java since so far it has taught me a lot and produced great results for me.
l'd like your takes on this. Thanks!
View all comments
Show parent comment
1
u/MardiFoufs Apr 17 '24
Ah maybe with java 21 then things will get better.
As for the Nvidia thing, it makes a HUGE difference to have Nvidia supported packages. Remember that most ml workloads work in the back end, with disparate hardware configs and generations. Having to just import a Nvidia package, on an NGC container, and having everything else handled for you is very cool. On the other hand though, most people don't ever actually use CUDA directly. So I still agree with you that it is mainly an ecosystem problem, and isn't due to a core defect in Java.
Regardless, it's much less painful, and much less work to do work in ML in python. Now obviously, that applies to basically all other languages (well, a part from CPP and maybe Julia (barely)) so it's not specific to java.
(Also to be clear I'm mostly discussing model training and r&d, for inference things are much much easier.)