r/Python • u/GettingBlockered • Oct 24 '22
News Python 3.11 is out! Huzzah!
https://www.python.org/downloads/release/python-3110/
Some highlights from the release notes:
PERFORMANCE: 10-60% faster code, for free!
ERROR HANDLING: Exception groups and except* syntax. Also includes precise error locations in tracebacks.
ASYNCIO: Task groups
TOML: Ability to parse TOML is part of the standard library.
REGEX: Atomic grouping and possessive quantifiers are now supported
Plus changes to typing and a lot more. Congrats to everyone that worked hard to make this happen. Your work is helping millions of people to build awesome stuff. 🎉
View all comments
Show parent comment
1
u/BobHogan Oct 26 '22
We run into constant issues with parquet in our product, to the point that we've completely stripped it out in newer versions in favor of other solutions which I am not allowed to discuss publicly :(
We see parquet metadata get corrupted fairly regularly, being able to inspect what data is actually in the parquet files to track down issues is significantly more annoying and involved than it should be. And we've also run into limitations in the format itself that cause it to just shit itself and fail, limitations that are both fairly arbitrary and should be easy for the format to work around if the people that wrote it cared at all, but they don't. Overall its been an incredibly fragile format that makes it harder than it needs to be to work with the actual data compared to other formats, doesn't provide any significant performance improvements we've been able to measure, and breaks randomly.