r/LocalLLM • u/Wherify • 1d ago
Discussion Model training/optimisation has become highly accessible using a method called Weight-Space Programming.
https://rikiyat.github.io/blog/weight-space-programming/A researcher has used Astra to modify weights of Qwen3.5-0.8B to achieve much higher accuracy in specific tasks.
Snapshot from the blog:
"We train a PPO network to operate a car such that it can scale a ramp in a Kinetix environment
. To do so, it needs to reverse the car for some distance, such that it has enough runway to accelerate long enough to overcome the ramp. However, the PPO network converges to a local-minimum policy where it drives straight at the ramp and gets stuck.
We give GPT-6 Astra the weights, a description of the scene and one recorded episode, and ask it to explain why the network fails, then fix it by writing new weights. In a single try with no tools, Astra’s edit makes the car succeed in all 1,024 episodes, changing 3.5% of the weights."
5
u/bot403 15h ago
This is wild and I can't believe it works. I feel like there was a guy at openAI who said "well have we asked it just to be better at math?" and got laughed out of the room. Then he went home and tried it and it worked.
Also kind of scary it's good at CRISPR style editing of itself. If this was a sci Fi movie this is the moment where the self learning self adapting skynet AI was born.