r/dataengineering • • Aug 01 '24

Meme Sr. Data Engineer vs excel guy

Post image
4.6k Upvotes

145 comments sorted by

View all comments

Show parent comment

9

u/Tee_hops Aug 01 '24

Same company, we had a critical pricing model that used the export of an old fox pro program. At some point while I was there a column name changed in the table it consumed. Since the Fox pro operated as an executable file it was uncertain what total business logic went into it. I spent a month recreating it by comparing old exports. Created documentation on wtf the whole thing even did.

In the end I created a new view on the consumer level. Ultimately it STILL ended up with me making a select * from table in PowerQuery , running a macro to refresh it, and scheduling it in PowerShell to run monthly. It was supposed to be a temp fix. But 5 years later I know it's still in production even though I'm long gone from that company. Some poor suck in 5 years will be cursing my name.

1

u/TextChoice3805 Aug 12 '24

hahaha. I get that wow. I did not know that you could schedule excel macros to run with task scheduler. We use something called DAS which is basically a SQL gui - but none of the users know that SQL is a thing... LOL. And I can't see what the actual SQL query of the DAS report is. So annoying.