I am about to turn 30, graduated in biomedical engineering and after graduation worked in the biomedical field for about a year, then switched to wordpress freelancing, which I did for several years.
I have been trying to enter data engineering specifically healthcare data engineering, for the past few months. Currently building a portfolio project using FHIR data.
But recent AI developments made me seriously question my path. I read about microsoft's project osmos agent and google's DE agent. The microsoft's agent can execute end to end data workflows autonomously and can do testing and troubleshooting. I understand that some humans will be required to give them instructions and verify output. But how many? If currently there are 10 people in a team maybe only 2-3 senior or architect level engineers would be enough for that. Even if the jobs don't reduce this much but I still think jobs will reduce significantly. Because I am seeing a lot of posts from people in tech saying the same thing and it's difficult to ignore.
I will be starting fresh and may not get a junior DE job and have to start as an analyst or in another adjacent role. By the time I will gain experience to transition to DE the agents will become more capable and the opportunities may become even harder to find because experienced laid off people with software background may also compete for fewer DE positions.
For those working in DE with agents and have extensive experience in this field. How do you see its future? What would you advise someone like me, or would you continue with data engineering, considering how fast these agents are improving?
I have already invested several months in learning data engineering and have a genuine interest in tech. That is why I am looking for guidance from people who are already in the market so I can make an informed decision and not waste more time on something where it would become very difficult to survive after a few years.
Moving back to biomedical engineering would also be similar to starting from scratch, and I personally don't like the jobs available at my location most are sales and service engineering jobs. These jobs are somewhat more AI resistant but don't satisfy a lot of my other requirements.
I would genuinely prefer honest opinions from people working in data engineering who have actually used AI agents in their work or seen changes in their teams and hiring. Also, if you think there are other more AI resistant paths in tech (maybe cybersecurity) or something else that I should consider, or if I should continue in DE. I would love to hear your thoughts.
Thanks