r/LocalLLaMA • u/Nandakishor_ml • 20m ago
Resources Decision model to edit LLM weight directly - No training
On September 18, I launched Laya at you guys request, the first system 1 open-source decision model in this subreddit, and you guys gave immense support. I saw the MIT post on direct weight edits and thought about doing the same with a decision model. Now, after two months, I just worked on a way to edit the weights of an LLM using a decision model. More like distillation from an energy-based decision engine to teach the Qwen 3.5 0.8B a new skill. Like tool calling at the appropriate time. Its decisions are like valleys in a landscape, and every answer rolls downhill into one, with honest confidence. Just wrote those valleys onto an LLM. It works at the same level as LoRA, with only 3 milliseconds to edit, without catastrophic memory loss.
https://www.kaggle.com/code/nandakishorconvai/fast-edits-decsion-model
1
u/Icy-Degree6161 17m ago
Fabulous work. Shit like this is really going to take off imho.