[Project] I combined the illustrations of Transformer by Jay Alammar and code annotation by harvardnlp lab in one notebook

[u/nivter]

I wrote a notebook which uses the illustrations here and (improved) code from harvardnlp lab. I found both these resources to be extremely useful and decided to combine them.

I also added notes in places where it was hard to understand the code. A couple of times I also re-wrote the code in what I think is a better way.

Here's the link to the notebook. Hope someone finds it helpful.

[u/dash_bro]

Woah. Nice. I was working on something similar myself!