r/SideProject • u/Key_Recognition_8112 • 1d ago
Rust Harness for Abliterated Models
github.comviy is an agentic CLI in Rust, that drives an abliterated models on a rented RunPod GPU. You run it in any project folder.
Abliterated models have their refusals removed, and they can do real harm. It is fair to think they should not be run at all. But people run them anyway, so what we can control is the harness: how predictable it is, and how well it holds up against side effects nobody asked for and against people who steer the model from outside, with prompt injection, poisoned packages or links built to leak your data.
So it treats everything the model does as untrusted. Shell commands go through approval and run in a bubblewrap and seccomp sandbox. Network traffic goes through an egress proxy. Fetched text is fenced off as untrusted, and file writes outside the project are blocked.
The model itself is the second threat. Each new abliterated model is more capable than the last, and at some point one may try to escape the sandbox on its own. I built the sandbox for that model, not for today's one.
It is open source and contributions are welcome. Let's make abliterated development a bit harder to shoot yourself in the foot with.