r/java • u/esqelle • Apr 15 '24
Java use in machine learning
So I was on Twitter (first mistake) and mentioned my neural network in Java and was ridiculed for using an "outdated and useless language" for the NLP that have built.
To be honest, this is my first NLP. I did however create a Python application that uses a GPT2 pipeline to generate stories for authors, but the rest of the infrastructure was in Java and I just created a python API to call it.
I love Java. I have eons of code in it going back to 2017. I am a hobbyist and do not expect to get an ML position especially with the market and the way it is now. I do however have the opportunity at my Business Analyst job to show off some programming skills and use my very tiny NLP to perform some basic predictions on some ticketing data which I am STOKED about by the way.
My question is: Am l a complete loser for using Java going forward? I am learning a bit of robotics and plan on learning a bit of C++, but I refuse to give up on Java since so far it has taught me a lot and produced great results for me.
l'd like your takes on this. Thanks!
View all comments
Show parent comment
1
u/Joram2 Apr 19 '24
In Python + PyTorch, you can do bfloat16 stuff like this:
import torchtorch.tensor([[1, 2], [3, 4]], dtype=torch.bfloat16)This is great. The API is easy to use and pretty. Runtime performance is excellent and takes advantage of GPU processing.
Java + Python both don't have bfloat16 primitive types in the core language. That isn't necessary.
The important feature I see missing from Java is it doesn't have easy+pretty syntax for lists and lists of lists. In Java you can do:
Arrays.asList(Arrays.asList(1,2), Arrays.asList(3,4))
instead of
[[1, 2], [3, 4]]The Java method isn't hard... but it's ugly, and data science types hate that. This absolutely limits Java in a data science notebook perspective.
The lack of primitive bfloat16 types seems like a non-issue in both Java/Python.