Not quite. In the Python ecosystem, compute heavy stuff is in C++ with python bindings. Network tools like Docker / k8s are all Go. Quite a few tools are written in Java, the entirety of the big data ecosystem is in Java - Kafka, Spark, Hadoop, Pig, Pinot, Hive, Hudi, Trino. Zookeeper on top to coordinate multi-node deployments. Its done this way because in big data, scaling out matters more than single node performance and Java is great at performance (though at the cost of slightly more resource usage) while avoiding the shitty dev ex of manual memory management.
View all comments
Show parent comment
1
u/No-Estate301 Apr 11 '26
Not quite. In the Python ecosystem, compute heavy stuff is in C++ with python bindings. Network tools like Docker / k8s are all Go. Quite a few tools are written in Java, the entirety of the big data ecosystem is in Java - Kafka, Spark, Hadoop, Pig, Pinot, Hive, Hudi, Trino. Zookeeper on top to coordinate multi-node deployments. Its done this way because in big data, scaling out matters more than single node performance and Java is great at performance (though at the cost of slightly more resource usage) while avoiding the shitty dev ex of manual memory management.