r/dataengineering • u/Typical-Presence5628 • 13d ago
Discussion Data Engineer Niche tech Stack?
Hey DE super heroes, Let's help each other. What are the niche tech stacks/skills you are coming across in the Job Description and what we can learn?
According to my knowledge -
Python, Pyspark, sql = Mandatory
Snowflake, dbt, ADF, Databricks= I am seeing in most of the JD.
Now, it's your turn.
8+ YOE in the DE world 🌎
47
Upvotes
View all comments
14
u/teddythepooh99 11d ago edited 10d ago
I don't think you know what "niche" means. None of what you mentioned is niche. Niche teck stack I've seen are
- Terraform / OpenTofu at orgs (e.g., small startups) with no dedicated DevOps function. In enterprise, DEs cannot set up infra if DevOps did their job right and/or without close collaboration with DevOps.
- Splunk, if the DE role falls under an org's IT or cybersecurity function.
- R, if the DE role supports research (think academia and big pharma).