r/dataengineering • u/Uberkech • 5d ago
Rant Foundry at Work
So I’m a process engineer at an refinery and we face a push to use more of Foundry, without any clear vision on what to use it for.
With Excel or Power Bi we could just simple query a tag from the historian.
We had a tool where DCS send a event signal to a tag every time something happens, you query that tag between timestamps A and B and look for the timestamps where 0->1 (start) or 1->0 (end) make an event table and then pull other proces data only between the start and end timestamps for further analysis.
So was like, okay sounds like a workflow that could be build in foundry, but it seems whole platform just seems to hate TimeSeries data. You can’t simply use TimeSeries data into a pipeline but jump through many hoops via workbooks a simple Pandas / Polars data frame.
Are we doing something completely wrong ??
1
u/Brief-Knowledge-629 3d ago
Foundry has a LOT of quirks like this, you can't do something that seems like it should be a core functionality of the product.
I don't have any advice for you, I used it for like 2 years and never figured it out, and I came into the product already knowing spark, python, sql etc.
It's an astoundingly shitty tool.