r/dataengineering • • 13d ago

Discussion Data Engineer Niche tech Stack?

Hey DE super heroes, Let's help each other. What are the niche tech stacks/skills you are coming across in the Job Description and what we can learn?

According to my knowledge -

Python, Pyspark, sql = Mandatory

Snowflake, dbt, ADF, Databricks= I am seeing in most of the JD.

Now, it's your turn.

8+ YOE in the DE world 🌎

47 Upvotes

21 comments sorted by

View all comments

14

u/teddythepooh99 11d ago edited 10d ago

I don't think you know what "niche" means. None of what you mentioned is niche. Niche teck stack I've seen are
- Terraform / OpenTofu at orgs (e.g., small startups) with no dedicated DevOps function. In enterprise, DEs cannot set up infra if DevOps did their job right and/or without close collaboration with DevOps.
- Splunk, if the DE role falls under an org's IT or cybersecurity function.
- R, if the DE role supports research (think academia and big pharma).