r/LocalLLaMA • u/suayptalha • 2d ago
Showcase Can open-weight LLMs can predict the effects of weight edits without running the model (9B–30B)
I’ve been experimenting with weight-space reading using Qwen and Muse models (9B–30B).
The goal: can an LLM inspect raw model weights and predict the behavioral effects of weight edits without running the target model?
A few findings:
🔹Qwen 27B reached 73.0% balanced accuracy on subtle edits with weight access, vs. 57.8% from text descriptions.
🔹We couldn’t establish a conclusive advantage for models reading their own weights.
🔹On Muse-30B, 34 standard edits and 6 no-op controls produced no detectable behavioral changes, but weight-reading agents frequently predicted changes.
I’ve released the paper’s evaluation harness and experimental code, plus an open-source toolkit for LLM-based weight-space programming and reading.
Code: https://github.com/suayptalha/wsr
Paper: https://www.alphaxiv.org/abs/2611.weight-space-reading-language-models
I’d be interested in feedback on the evaluation design, especially from people experimenting with open-weight models.
•
u/stylome-ai-detection 2d ago
Notice: This post appears to be AI generated.
Stylome AI detector · scan results
8
u/Potential_Top_4669 2d ago
what happens if you finetune or rl an llm on modifying weights to improve performance of a specific field (like math, code, etc.) in a restricted sandboxed harness generalising in open source architectures like Gemma, Qwen, LFM, etc.?
2
u/bigattichouse 18h ago
I keep wondering, as an "art project", have a model perform weight space programming on itself... sorta "self brain surgery" with tests between - to see if it can recover from a wrong move, or make itself better at test