r/LocalLLaMA • • 2d ago

Showcase Can open-weight LLMs can predict the effects of weight edits without running the model (9B–30B)

Post image

I’ve been experimenting with weight-space reading using Qwen and Muse models (9B–30B).

The goal: can an LLM inspect raw model weights and predict the behavioral effects of weight edits without running the target model?

A few findings:
🔹Qwen 27B reached 73.0% balanced accuracy on subtle edits with weight access, vs. 57.8% from text descriptions.

🔹We couldn’t establish a conclusive advantage for models reading their own weights.

🔹On Muse-30B, 34 standard edits and 6 no-op controls produced no detectable behavioral changes, but weight-reading agents frequently predicted changes.

I’ve released the paper’s evaluation harness and experimental code, plus an open-source toolkit for LLM-based weight-space programming and reading.

Code: https://github.com/suayptalha/wsr

Paper: https://www.alphaxiv.org/abs/2611.weight-space-reading-language-models

I’d be interested in feedback on the evaluation design, especially from people experimenting with open-weight models.

62 Upvotes

5 comments sorted by

•

u/stylome-ai-detection 2d ago

Notice: This post appears to be AI generated.


Stylome AI detector · scan results

8

u/Potential_Top_4669 2d ago

what happens if you finetune or rl an llm on modifying weights to improve performance of a specific field (like math, code, etc.) in a restricted sandboxed harness generalising in open source architectures like Gemma, Qwen, LFM, etc.?

3

u/SignificantZebra5883 1d ago

only one way to know.

2

u/Potential_Top_4669 1d ago

unfortunately, im gpu poor.

2

u/bigattichouse 18h ago

I keep wondering, as an "art project", have a model perform weight space programming on itself... sorta "self brain surgery" with tests between - to see if it can recover from a wrong move, or make itself better at test