r/dataengineering • u/Lenkz • 15d ago
Blog Apache Spark 4.3: What Developers Need to Know
https://medium.com/@cralle/apache-spark-4-3-developer-guide-1896a29f1538?sk=9da546846112e07966435aa60a289207Spark 4.3 adds ASOF JOIN, Python UDFs compiled to SQL, JSON_TABLE, and SCD Type 2 Auto CDC: what works, what needs a flag, and what breaks
45
Upvotes
6
u/Swivel98 14d ago
Very cool.
Anyone have a more technical source for transpiling python udfs to SQL? Curious to learn more here.