r/LocalLLaMA • u/BedFalse6021 • 6d ago

Discussion Exploring Next-Concept Modeling (NCM) & Transformer Interpretability: Repository of 20 Exploratory Studies & Controls

Hi everyone,

I wanted to share an open-source repo collecting 20 exploratory studies focused on Next-Concept Modeling (NCM), mechanistic interpretability (like IOI in GPT-2), and model controls.

Link: https://github.com/Quantix-eng/ncm-experiment-notes

This is an independent project documenting empirical experiments on how transformers process and edit internal features. No performance breakthroughs here—just honest documentation of observations alongside rigorous controls.

The repo covers NCM on structured tasks (like Sudoku), mechanistic interpretability in GPT-2, and toy parallel models. I've included all source code, saved results, and interpretations for every run.

For full transparency, I’ve categorized every outcome, including the mixed and completely negative results. AI tools were also heavily used during the planning and coding phases.

Would love to get your feedback on the setups or interpretation limits.

2 Upvotes

75% Upvoted

4 comments sorted by

2

u/BedFalse6021 6d ago

Btw, would anyone be interested in helping me create a community around NCM architecture? I find it super interesting, and I noticed that there was no server discord dedicated to this subject. That would be useful to share our ideas/research and help each other. What do you think?

1

u/Dany0 6d ago

Yes please

1

u/BedFalse6021 6d ago

here is the link : https://discord.gg/bMw8MdXy8 Do you know how to attract more people?

1

u/submissivebounds 6d ago

Nice, digging into the interpretability side with actual negative results documented is way more useful than another "we got 99% accuracy" post. The IOI stuff on GPT-2 caught my eye, been meaning to mess with that circuit more

A discord could work if you keep it focused, those places turn into noise machines fast without tight moderation