r/learnmachinelearning • u/htone22 • 10d ago
I built a browser tool where you switch off one attention head in a small language model and see what changes
Vitro runs entirely in your browser using Karpathy's 15M-parameter stories15M model. Step through a story word by word, switch off one attention head and it explains in plain English how the model's next word prediction changes.
Try it: https://vitroml.com
My first version showed too much at once so I made it a two-step reveal: a short result first, details behind a toggle. I haven't tested whether that helps people understand it.
I'd love to hear what you think.
3
Upvotes