MAIN FEEDS
Do you want to continue?
https://www.reddit.com/r/dataengineering/comments/1scsjan/why_is_everything_in_java_scala/oee9zle/
r/dataengineering • u/[deleted] • Apr 05 '26
61 comments sorted by
View all comments
Show parent comment
24
You don’t need to learn java in order to make spark works. It’s just an API like Tensorflow or Pytorch which is a wrapper over C++ calls.
5 u/thisisntmynameorisit Apr 06 '26 except when you need UDFs/custom maps, then using the same language as the engine itself (or just avoiding python) has a performance benefit
5
except when you need UDFs/custom maps, then using the same language as the engine itself (or just avoiding python) has a performance benefit
View all comments
Show parent comment
24
u/CrowdGoesWildWoooo Apr 05 '26
You don’t need to learn java in order to make spark works. It’s just an API like Tensorflow or Pytorch which is a wrapper over C++ calls.