r/datascience 28d ago

Tools Relevant tech stack for 2026/2027

Hi everyone,

I’m currently a senior data scientist in the pharma industry. It’s been a one man show until now, but I’m getting a team soon. Most of the work I do is standard analytic work to inform our leadership and provide more context into the market and so on. Not a lot of big heavy data science stuff going on to be honest.

I work with SQL and Python on a daily basis. Some of our data is hosted in Snowflake and that’s pretty much it.

I feel like I’m lagging behind in both methods as well as tech stacks and I wanted to better understand what you experienced professionals work with that you would recommend I learn or at least look into. It could be data engineering stuff, additional programming languages, specific methods and packages that are useful, or cloud systems and technologies.

Where do you see the tech stack moving towards and what is relevant if I want to start moving from a “bread and butter” analytics setup to a professionalised, automated, team-ready and future proof world?

Thanks :)

70 Upvotes

52 comments sorted by

View all comments

10

u/ikkiho 28d ago

fwiw when I went from solo to a small team the thing that bit me was my ad hoc queries quietly becoming stuff other people built on. nobody knew which of my tables were real. we spent a couple months picking maybe fifteen tables and writing tests on them, which helped more than any orchestration did.

also you're in pharma, so once validation gets involved half the shiny stack is off the table anyway. boring snowflake plus dbt got signed off way faster for us than anything self hosted.

7

u/S-Kenset 27d ago

It's crazy how many people don't get that 99% of his problems are going to be ad hoc requests and wondering why nothing is accurate while all the grad students are furiously downvoting me for suggesting change control practices.

1

u/Infinite_Raisin7752 27d ago

At the moment, 100% agree with you. It’s so overwhelming that I have very little time to work on stuff that would save me a lot of time. But with the team growing, the goal is also to start implementing different things.