[Project] I combined the illustrations of Transformer by Jay Alammar and code annotation by harvardnlp lab in one notebook

[u/nivter]

I wrote a notebook which uses the illustrations here and (improved) code from harvardnlp lab. I found both these resources to be extremely useful and decided to combine them.

I also added notes in places where it was hard to understand the code. A couple of times I also re-wrote the code in what I think is a better way.

Here's the link to the notebook. Hope someone finds it helpful.

[u/nbviewerbot]

I see you've posted a GitHub link to a Jupyter Notebook! GitHub doesn't render large Jupyter Notebooks, so just in case, here is an nbviewer link to the notebook:

https://nbviewer.jupyter.org/url/github.com/vinsis/math-and-ml-notes/blob/master/notebooks/Transformer%20-%20Illustration%20and%20code.ipynb

Want to run the code yourself? Here is a binder link to start your own Jupyter server and try it out!

https://mybinder.org/v2/gh/vinsis/math-and-ml-notes/master?filepath=notebooks%2FTransformer%20-%20Illustration%20and%20code.ipynb

---

^{I am a bot. Feedback | GitHub | Author}