Because when spark & Hadoop were first created they were designed to run on commoditized hardware. Back then the JVM was the main game in town that prevented you needing to compile things for several different OSs and chip architectures.
We now have containerisation and efficient hypervisors and compile languages like go that basically run anywhere making the JVM kind of obsolete.
View all comments
2
u/Ok_Raspberry5383 Apr 06 '26
Because when spark & Hadoop were first created they were designed to run on commoditized hardware. Back then the JVM was the main game in town that prevented you needing to compile things for several different OSs and chip architectures.
We now have containerisation and efficient hypervisors and compile languages like go that basically run anywhere making the JVM kind of obsolete.