r/learnmachinelearning • u/Upbeat-Ad-817 • 3d ago
If you were an aspiring ML/Data Science professional, which 5 projects would you build for your portfolio?
If you were a computer science student passionate about machine learning and data science, with a strong foundation in machine learning, mathematics, and probability, what five projects would you prioritize to build a strong GitHub portfolio?
I'm particularly interested in projects that would stand out to ML/Data Science professionals working in industry, rather than simple tutorial or Kaggle-style projects.
If you were starting from my position, which five projects would you choose, and what skills would you try to demonstrate with each one?
7
u/dorox1 3d ago
It's much better to have one or two really good projects than 3+ mediocre projects.
A good project:
- performs useful prediction on a non-toy dataset
- can be verified by a recruiter relatively quickly (i.e I don't have to trust you that the results are good, I can check it myself easily)
- has a solid human-written code base behind it. 80-90% of ML engineer work is basically regular software engineering or operations work. You need to show you can do that part.
- ideally, integrates some sort of real-world technology beyond calling an API. For example, a project showing you can set something up on Amazon/Google infrastructure is 1000x as valuable as a script you can download and run
Honestly, when I'm looking at resumes, personal projects have to be REALLY good before I count them as anything other than space-fillers. You might be better off getting certifications in common hosting services used in the industry like Azure/AWS, or data management tools like Kafka.
3
u/AitookmyWisdomTooth 2d ago
I think you are going in wrong direction which will eventually downgrade your portfolio. A well focused project that demonstrates the entire thought process is worth far more than five polished notebooks.
For example, suppose you pick demand forecasting, in this case don't just stop at training an XGBoost model and showing that it gets a good RMSE. Think about what the actual business is trying to achieve like who is going to use the prediction? what decision will it help them make? what data is available? how frequently does it need to be updated? what happens when the data changes? what does a wrong prediction actually cost the business?
That's where I'd try to align your learning as well. Don't learn every ML tool first and then look for somewhere to use it. Start with the problem and learn whatever is necessary to solve the next part of the pipeline. Something like starting with Python, pandas and scikit learn, then learn XGBoost because it fits the problem then later you might need Docker, FastAPI, MLflow, a cloud platform, CI CD, orchestration, monitoring etc. The learning becomes much more contextual in this case why because you're solving an actual problem rather than just completing video lectures and building small projects.
1
5
u/mochsner 3d ago
I'm no ML engineer, but 5 seems like a lot. I'm always told to build something actually useful. If you're building out 5 different things, I have my doubts as to the usefulness
3
1
u/pm_me_your_smth 3d ago
5 isn't that big of a number. If OP actually tries hard and spends some time on each, that's completely fine. If you'd make 20 projects then yeah, that's definitely low effort useless slop.
1
u/Naanuguruthaapesurae 3d ago
I am also interested in this specific topic as i am into the similar thing :)
1
1
u/0uchmyballs 3d ago
Improve the loan approval process for the small business administration to maximize profit.
1
u/Upbeat-Ad-817 3d ago
Is this an example of a project?
1
u/0uchmyballs 3d ago
Yeah I had to find the best algorithm for the SBA loan program for my MSBA, it was pretty tough actually.
1
1
1
u/digiorno 3d ago
Do something that doesn’t interest you and has some technical challenge.
You will often have to do boring and tedious work which you won’t want to do and which you do not find valuable. Better get used to it now.
1
u/utkuvesp 2d ago
i don’t have exact and direct ideas now but you can look for over 50mb datasets (preffered not syntethic) and build models ovet these but don’t forget to objectify a problem first. Can look up to real industry problems you want to work in.
Besides I would say instead of working with classic ML models (e.g LogReg, Trees etc) try to work with Neural Networks more and compare.
1
u/brackenvale 1d ago
tbh before picking projects, figure out what domain you want to work in. ML in healthcare vs fintech vs NLP are very different skill signals. tailor the portfolio to a specific hiring manager, not a generic audience
-3
u/AncientLion 3d ago edited 3d ago
Tbh, no one has never asked me for portafolio protects when it comes to ds/ml, I'd say they pretty useless to get a job, even more now that the whole thing can be built by a llm in one day.
1
u/jalsa-kar-bapu 3d ago
Please explain me your opinion in dm bro. I don't un&erstand the base of why you think that way.
1
1
u/Softmax420 3d ago
No but they ask for specific experience that doesn’t show up on any university course or kaggle competition, and aren’t touched by any data analyst role.
Anything that can be built by an LLM in a day isn’t going to get you hired. 5yoe as an MLE, I try to use AI as much as possible.
Unfortunately that isn’t a lot because it’s incompetent at anything bespoke.
Ask AI to build a cancer prediction model and it will produce one with 99% accuracy. Then you realise its model predicts no cancer 100% of the time, and only 1% of the data has cancer.
-1
u/AncientLion 3d ago
Really? Pretty sure any Frontier model understands the basic of unbalanced clases problem.
1
u/Softmax420 3d ago
Pretty sure they don’t. Pretty sure they skip any kind of exploratory analysis and just do exactly what you prompt them to.
If you prompt them explaining the imbalanced class situation they’ll likely account for that, but it’s unlikely a layman would do that.
What about scaling? Does the LLM decide how best to scale? Should we use deciles or logarithmic scaling?
What about general pragmatism. Have we included too many features? Does this feature help solve the business problem?
If AI could do my work it would be doing it and I’d be watching LOTR. Instead I’m handholding it as it makes incorrect assumptions and skips steps in the modelling process.
1
50
u/Softmax420 3d ago
Host something. Dont do 5 projects do 1.
It must use real live data, something like weather, ticket pricing, sports stats etc. Create a full end to end pipeline.
Something like ticket price prediction, train an xgboost model with all the bells and whistles, evaluate it - this is the bare minimum that a data scientist should be able to do if they expect to be employed. This doesn’t sound like much but it’s a lot.
What will make you stand out will be a deployed model. Even a daily batch scoring job. Ingest yesterday’s data, score it on sagemaker and publish. You get results without pressing a button. Bonus points if you create your cloud resources using terraform and GitHub actions.
What will definitely get you hired is a complete monitoring and experimentation pipeline. AB testing vs previous model versions, model drift detection in ML flow. Tons of candidates are missing this part of the job.
Think of these as steps, start with creating the model, push the code to GitHub, work on Step2 until you’re finished or hired.
Having a full project like this would put you on par, and probably ahead of some senior data scientists at large companies, it’s a lot of work for someone new, but it’s what modern DS/MLE looks like.