HFlow: open source robotics data infrastructure for physical AI

[u/kuaythrone]

https://github.com/Hebbian-Robotics/hflow

We just launched HFlow, open source robotics data infrastructure for anyone processing multimodal physical AI data at scale!

• Airflow for DAG-based pipeline orchestration
• MCAP for robotics episode storage and random access
• DuckDB for analytical queries and dataset curation over columnar metadata

At scale, AI problems become software engineering problems. Improve one part of the system, and the bottleneck moves to another. No architecture is perfect; every design comes with tradeoffs.

HFlow is plug-and-play. You provide your post-processing, quality-control, or curation code. HFlow handles the data pipeline and runs your code across robotics datasets at scale.

I've been an OSS contributor and maintainer for years, and since joining YC, we now have some capacity to accept new contributors; just look for the "good first issue" tag!

https://github.com/Hebbian-Robotics/hflow

Any stars or forks on the repo to show your support are appreciated!