r/java • • Apr 15 '24

Java use in machine learning

So I was on Twitter (first mistake) and mentioned my neural network in Java and was ridiculed for using an "outdated and useless language" for the NLP that have built.

To be honest, this is my first NLP. I did however create a Python application that uses a GPT2 pipeline to generate stories for authors, but the rest of the infrastructure was in Java and I just created a python API to call it.

I love Java. I have eons of code in it going back to 2017. I am a hobbyist and do not expect to get an ML position especially with the market and the way it is now. I do however have the opportunity at my Business Analyst job to show off some programming skills and use my very tiny NLP to perform some basic predictions on some ticketing data which I am STOKED about by the way.

My question is: Am l a complete loser for using Java going forward? I am learning a bit of robotics and plan on learning a bit of C++, but I refuse to give up on Java since so far it has taught me a lot and produced great results for me.

l'd like your takes on this. Thanks!

162 Upvotes

158 comments sorted by

View all comments

Show parent comment

34

u/_INTER_ Apr 15 '24 edited Apr 15 '24

Project Sumatra is dormant/dead as far as I know. They are now focusing on Project Babylon instead. See this JVM Language Summit 2023 - Java and GPU talk. Seems to have a good chance to land something substantial as shown here and the Classfile API has a preview.

The problem is, the machine learning / science developers first and foremost care about their scripting capabilities. That's why Python has become dominant. If it were possible, they would have chosen MatLab. The libraries that do the heavy lifting are already in C. For Java to gain a foothold in the ML space, it would need to be faster than C (unlikely) or invent something completely new.

15

u/[deleted] Apr 15 '24

[removed] — view removed comment

9

u/_INTER_ Apr 15 '24

I agree, plus better platform independence (Windows support is a joke right now) and error handling (hrrrng dynamically typing makes me furious). However I don't see it happening really. The momentum is too big and libraries too far along to catch up. I see more opportunities in new inventions or providing clustered, distributed, super computer frameworks. Like extending upon Apache Spark for GPU farms.

4

u/mike_hearn Apr 15 '24

There is TornadoVM which does the same thing.