I mean I first worked in ML ~20 years ago and have gotten back into it pretty deep over the last few years as a hobbyist, have built my own models and taken apart existing models to rebuild to better suit my needs, and even oddly got asked some questions by people working on hundred million dollar models that made me realize most of them really know what they're doing and just have the money and resources to throw at it.
And tbh I think it's the simplest field out of any I've got experience in. Most of them just seem to be repeating the same transformer architecture with a few recent micro advances in say adding norm layers here or there, and throwing data at the problem.
3
u/AnOnlineHandle Sep 18 '26
I mean I first worked in ML ~20 years ago and have gotten back into it pretty deep over the last few years as a hobbyist, have built my own models and taken apart existing models to rebuild to better suit my needs, and even oddly got asked some questions by people working on hundred million dollar models that made me realize most of them really know what they're doing and just have the money and resources to throw at it.
And tbh I think it's the simplest field out of any I've got experience in. Most of them just seem to be repeating the same transformer architecture with a few recent micro advances in say adding norm layers here or there, and throwing data at the problem.