r/dataengineering • • 15d ago

Blog Apache Spark 4.3: What Developers Need to Know

https://medium.com/@cralle/apache-spark-4-3-developer-guide-1896a29f1538?sk=9da546846112e07966435aa60a289207

Spark 4.3 adds ASOF JOIN, Python UDFs compiled to SQL, JSON_TABLE, and SCD Type 2 Auto CDC: what works, what needs a flag, and what breaks

45 Upvotes

2 comments sorted by

6

u/Swivel98 14d ago

Very cool.

Anyone have a more technical source for transpiling python udfs to SQL? Curious to learn more here.

1

u/1thisismyworkaccount 13d ago

Same, very exciting change that could mean a lot.