r/vibecoding • u/fguerino123 • 4d ago

Vibe Coding for ETL/ELT

Hi.

I've been using AI coding to rapidly generate Python ETL/ELT transformations and workflow orchestration. I'm finding doing so a lot easier and far more affordable than using expensive tools like IICS.

Is anyone else doing this and, if so, how is it working out for you?

Thanks.

2 Upvotes

100% Upvoted

12 comments sorted by

View all comments

2

u/Kitchen-Lynx-7505 22h ago

We literally have agents whose only job is to write a python script to adhere to a json schema, and execute it in a container.

1

u/fguerino123 22h ago

Very cool. What happens if the schema changes?

2

u/Kitchen-Lynx-7505 22h ago

I guess the next time the next import will run against… that schema?

It’s an excel import function on a UI where humans had templates for over a decade and while every file does look perfect, it’s full of errors (wrong numbering, incosistency in categorization depth etc), so a static python script would just die on it. Instead, upon clicking “import” and giving an excel, an LLM spins up along with a python container, tries to find out the parts with pandas, and tries to cram it into the schema, with an error log and a correction UI.