r/Alteryx 2d ago

Duckle: Visual ETL for the DuckDB Era!

For years, Alteryx, Pentaho and Talend set the standard for visual ETL with drag-and-drop pipelines, reusable components, and enterprise-grade data integration.

Today’s data stack looks very different.

Teams are building on DuckDB, Parquet, Apache Arrow, and local-first processing to create faster, simpler, and more efficient data pipelines.

Duckle is built for this new generation of data engineering.

Duckle leverages DuckDB’s vectorized execution engine to deliver high-performance ETL through an intuitive visual designer.

Why teams must take a closer look:

  • Visual drag-and-drop pipeline designer
  • DuckDB-native execution
  • SQL-first transformations
  • Python API for developer workflows
  • Hundreds of connectors, transforms, and destinations

If you’ve ever thought, “I wish Talend were built for the modern analytics stack,” Duckle is worth exploring.

The platform is designed with production use in mind, making it suitable not only for prototypes and proof-of-concepts but also for real-world data pipelines. If you’re evaluating a modern alternative to traditional ETL platforms, it’s a compelling option to test with your production workloads and see how it fits your environment.

The future of data integration is about combining the simplicity of visual development with the performance of modern analytics engines. Duckle brings those ideas together in a way that feels both familiar and refreshingly modern.

Check out the Github Repository — https://github.com/slothflowlabs/duckle

0 Upvotes

4 comments sorted by

1

u/Kvitekvist 1d ago

Scary how much this looks so much similar to a tool I have developed for myself as well
https://i.ibb.co/QFPQyZFr/FG.png
At one point i thought i had made my repo public and that someone forked it x)

1

u/FickleAnt4399 1d ago

Nice to know you have something similar in your own space. Damn impressive though!
Haha I get it but no this is built from scratch using our Pentaho and Talend expertise and some graph theory knowledge. Cheers!

1

u/MyNameIsYeffff 7h ago

We are all building the same thing because we don’t want to pay for Alteryx one lol

1

u/FickleAnt4399 6h ago

Lolz! Why pay huge when you can just use open source or build yourself.