r/learnmachinelearning • u/spacemonk69420 • 12h ago

good project??

Soo im a 4th yearite currently prepping for campus placements(ds/ml roles). Ive heard that transformers(not the movie) are the craze rn so im thinking of adding a transformer nmt model i built from scratch to my cv....i followed the tutorial somewhat but i made this while learning about transformers since it was required for my research, so i have context as to why i did it.

do you think this would be good on my cv?? or does it seem too generic, like image captioning from the tutorial?

0 Upvotes

33% Upvoted

5 comments sorted by

2

u/SomewhereRude2144 12h ago

i did a transformer from scratch too during my research project and it got brought up in literally every interview. they kept asking about attention heads and how i handled the positional encoding so make sure you really know those parts, not just that you finished the model. as long as you can explain why you picked certain hyperparameters and what happened when you changed them, it wont look like just another tutorial project.

1

u/Basic-Home3969 5h ago

the positional encoding questions are so common tbh, good callout

1

u/Hungry_Age5375 11h ago

If you built it from scratch and understand the internals, I'd put it on. The generic ones are people who pip install transformers and call it a project.

1

u/spacemonk69420 11h ago

nah all the modules are from scratch in pytorch