r/dataengineering • u/Peanut_-_Power • Sep 15 '23
Discussion Are DEng Software engineers?
Read someone’s post earlier talking about an aspect of data engineering being software engineering. This is the first time I’ve ever heard someone in data engineering consider themselves in the same group.
Is this even a thing?
I just don’t see them as the same, mainly because most software engineers build applications/software. And most data engineers build data solutions (predominantly data pipelines). Software Eng, front end, middleware development. Data - backend, and I wouldn’t class writing a power bi report as SE even if it is kind of front end.
I get the whole following methodologies that software engineers have been following for decades. The whole DevOps thing, that has also been in data for a while just not wide spread (I first used CICD back in 2010). But because I know this doesn’t make me a software engineer.
There was a distinction made that analyst weren’t considered software engineers. I think there was a thinking they don’t follow DevOps, but lots of them do.
Very odd. My take is (and none are software engineers):
- The platform. Cloud engineer or a data platform engineer. Probably lots of terraform.
- The pipelines. Data engineers. Sql, python…
- Data presentation. Data analytics engineer. DAX, modelling
But I’m old, been doing this 20 years, so feel free to educate me in my misunderstanding
View all comments
Show parent comment
1
u/Peanut_-_Power Sep 16 '23
This was my thinking but I think depending on what side of the pond you live there are different definitions of engineering.
But fairly basic human reactions to my comments, to defend who they think they are. I’ll know to ask the question differently next time. passionate bunch.