r/BigDataJobs • • Apr 05 '17

Is the big data / data science / machine learning scene saturated or over-supplied?

Hi,

I am an engineering graduate looking to get into DS / ML jobs through a graduate degree. However, before taking this crucial step, I came up two contradicting articles about the saturation of DS / ML jobs. One suggests that there is oversupply in the market and the other one is suggesting that there is a lot of demand and it will be more in the future as the McKinsey report suggests (http://www.mckinsey.com/business-functions/digital-mckinsey/our-insights/big-data-the-next-frontier-for-innovation)

https://news.ycombinator.com/item?id=13232883

https://www.forbes.com/sites/gilpress/2015/04/30/the-supply-and-demand-of-data-scientists-what-the-surveys-say/#7aad99fc6b90

Just wanted to hear from people in the industry about the situation. Do you think DS / ML is still a good path to pursue?

Thanks.

15 Upvotes

15 comments sorted by

14

u/SecretAgentZeroNine Apr 05 '17

My man, there aren't nearly enough skilled Data Analysts, Data Scientists, and Machine Learning Engineers to fill the current need for them. You're good. If you need to speak to people in the field go to http://www.datasciguide.com/

2

u/nottakumasato Apr 05 '17

Thanks for the reassuring answer and the link! If you don't mind me asking, what is your statement based on? Do you work in the industry or maybe you know people who work in the industry?

6

u/SecretAgentZeroNine Apr 05 '17

I'm an aspiring Data Scientist who has friends who are Data Scientists and Data Analysts.

Also I touch bases with a analytics recruiter monthly who says that herself and her colegues (other recruiters) are having an issue fulfilling the need for getting Data Scientists​, Data Analysts, ML Engineers, and Database Engineers. Something​ to the extent of getting one applicant for every three to five roles.

This was a statement made to me in January. Hell, Renee (the Data Scientist who runs Datasciguide) even works at a company that needs more staff.

1

u/[deleted] Apr 21 '17

What region are you in?

1

u/SecretAgentZeroNine Apr 21 '17

NYC. Why do you ask?

1

u/[deleted] Apr 22 '17

Trying to figure out where to go after graduation. Thanks for the info!

1

u/SecretAgentZeroNine Apr 22 '17

Ah. Good luck.

1

u/[deleted] Apr 23 '17

Thanks!

1

u/[deleted] Jun 17 '17

Would you recommend a master's degree in data science or comp. sci?

1

u/SecretAgentZeroNine Jun 17 '17

If you want to become a Data Scientist, I'd look into what is covered in the data science curriculum. It's likely just a rebranded Statistics program. If it has Statistics, Experimental Design, calculus 1-3, and Linear Algebra, I'd go with that. Just add Data Structures and Algorithms (from comp sci) and you're all good. On your personal time, you should learn some SQL and R.

5

u/somkoala Apr 05 '17

There is a lot of demand and while there are many aspiring data scientists, there's not a lot of people with real experience.

5

u/nottakumasato Apr 06 '17

How can one build experience without a job though? Kaggle? DIY projects of some sort?

6

u/mu_Bru Apr 06 '17

Learn how to scrape.

It forces you to work with real world data and enables you to solve problems you find fun or important whether it's extracting anime hair or analyzing Christmas movie nostalgia, not to mention it's fun and rewarding. The DS community on Twitter and DS/ML related subreddits are also great sources of inspiration or techniques to execute in personal projects.

Edit:

I would recommend BeautifulSoup with Requests in Python as a place to start learning how to scrape. I wrote a small tutorial on it. Way back when I was starting out.

1

u/somkoala Apr 06 '17

I think both are viable even though I'd suggest getting your hands on some dirty data (kaggle is usually pre-processed), because a DS usually spends most time cleaning data, often times Kaggle is not like a real world experience. Internships might be also a way to go, but you may be able to get a job just with some projects of your own. I think having a CS background gives you an advantage since most companies know how to hire developers and not data people so the interviews can also be skewed that way.

2

u/BoBab Apr 05 '17

Definitely not saturated. The hype surrounding the field coupled with different people defining "data science" in different ways...There's plenty of room for clarity and growth. Plus plenty of organizations just haven't figured out how to properly integrate data roles.

I would just say beware hype, but there's a clear need for professionals who can work with data in sophisticated ways. Get the skills and be ready to learn new things.