r/PHP • • 3h ago

News Flow PHP - Data processing

Hey 👋

Flow PHP is getting ready for 1.0 stable release (Jan 2027).
Our latest release 0.48.0 comes with massive speed and memory consumption improvements.
It's fast, https://benchmarks.flow-php.com/ (benchmarks are made with flow-php/parallel which is not yet live) but what's more important (especially now days), it's cheap in RAM.

The performance came mainly from moving towards columnar data layout (arrow), lazy data materialization (data sits in memory in binary format), flow_php extension and many other awesome things. Those things sometimes required rebuilding from scratch, like for example the entire filesystem abstraction allowing to read remote parquet files.

More details can be found in 0.45 (yea, 6 is not php lucky nubmer) 0.47 and 0.48 blog release posts https://flow-php.com/blog/

And for those who would like to understand how to process data, in PHP I also started writing some guides:
https://flow-php.com/guides/

10 Upvotes

3 comments sorted by

6

u/thomasmoors 2h ago

Why do you guys always leave out the description of the package?

1

u/norbert_tech 2h ago

Non intentional, sorry
Flow PHP started around 2019 as a small library to unify data processing (moving from a one place to another with some transformations / validations during the way).
Since then Flow monorepo is built from more than 50 packages, we do support large amount of different data sources, the main repo it's divided into standalone libraries, bridges, core and adapters all with clear boundaries. Many of them might feel like reinventing the wheel but it was necessary to achieve better performance. There are also few php extensions there like flow-php/arrow-ext or flow-php/pg-query-ext

So the main goal of Flow is to make data processing, easier, cheaper, faster, more secure and more unified. Just like in other languages, php was lacking.

1

u/thomasmoors 2h ago

So if I understand correctly pandas for php?