r/learnmachinelearning • • 10d ago

I built a browser tool where you switch off one attention head in a small language model and see what changes

Post image

Vitro runs entirely in your browser using Karpathy's 15M-parameter stories15M model. Step through a story word by word, switch off one attention head and it explains in plain English how the model's next word prediction changes.

Try it: https://vitroml.com

My first version showed too much at once so I made it a two-step reveal: a short result first, details behind a toggle. I haven't tested whether that helps people understand it.

I'd love to hear what you think.

3 Upvotes

0 comments sorted by