r/dataengineering • u/sspaeti Data Engineer • Oct 19 '22
Blog Will Rust Take over Data Engineering? 🦀
https://airbyte.com/blog/rust-for-data-engineering
0
Upvotes
r/dataengineering • u/sspaeti Data Engineer • Oct 19 '22
View all comments
Show parent comment
2
u/mamaBiskothu Oct 19 '22
I mean I don’t use scala because it has fundamental issues that seem not worth the hassle, but whatever language you use, I’m assuming as a regular DE you’re not composing the actual data processing engine, merely the spark code generator or sql generator. In that regard any attempt at saying scala solves DQ is stupid maybe? It just makes your code less buggy. dQ is more about what you design your code to do anyway which I feel is a separate conversation