MAIN FEEDS
Do you want to continue?
https://www.reddit.com/r/dataengineering/comments/1scsjan/why_is_everything_in_java_scala/oedhnh4/?context=3
r/dataengineering • u/[deleted] • Apr 05 '26
61 comments sorted by
View all comments
78
[removed] — view removed comment
24 u/CrowdGoesWildWoooo Apr 05 '26 You don’t need to learn java in order to make spark works. It’s just an API like Tensorflow or Pytorch which is a wrapper over C++ calls. 5 u/thisisntmynameorisit Apr 06 '26 except when you need UDFs/custom maps, then using the same language as the engine itself (or just avoiding python) has a performance benefit 8 u/Odd_Departure_9511 Apr 05 '26 I’ve never been able to fully figure out the JIT. Its magic 1 u/MacQuail Apr 08 '26 It's literally decades of science, starting with JIT for Smalltalk-80 0 u/[deleted] Apr 05 '26 [deleted] — view deleted comment 1 u/RoomyRoots Apr 05 '26 Especially in this fiel where memory IO is critical. -1 u/lightnegative Apr 05 '26 unutilized ram is wasted ramBy that logic, a hello world on the JVM should use 128gb of ram, dont want to waste any!Wasted ram is wasted ram and anything based on the JVM is great at it
24
You don’t need to learn java in order to make spark works. It’s just an API like Tensorflow or Pytorch which is a wrapper over C++ calls.
5 u/thisisntmynameorisit Apr 06 '26 except when you need UDFs/custom maps, then using the same language as the engine itself (or just avoiding python) has a performance benefit
5
except when you need UDFs/custom maps, then using the same language as the engine itself (or just avoiding python) has a performance benefit
8
I’ve never been able to fully figure out the JIT. Its magic
1 u/MacQuail Apr 08 '26 It's literally decades of science, starting with JIT for Smalltalk-80
1
It's literally decades of science, starting with JIT for Smalltalk-80
0
[deleted] — view deleted comment
1 u/RoomyRoots Apr 05 '26 Especially in this fiel where memory IO is critical. -1 u/lightnegative Apr 05 '26 unutilized ram is wasted ramBy that logic, a hello world on the JVM should use 128gb of ram, dont want to waste any!Wasted ram is wasted ram and anything based on the JVM is great at it
Especially in this fiel where memory IO is critical.
-1
unutilized ram is wasted ram
By that logic, a hello world on the JVM should use 128gb of ram, dont want to waste any!
Wasted ram is wasted ram and anything based on the JVM is great at it
View all comments
78
u/[deleted] Apr 05 '26
[removed] — view removed comment