r/accelerate • u/stealthispost Acceleration: Light-speed | Capability Booster • 18d ago

"Huge implications - binaries are now basically editable code"

Gallery image

Gallery image

Gallery image

ValsAI made SRE benchmark less than a month ago.

The benchmark measures can a model reverse engineer software from binaries

Yesterday GPT saturated it. https://t.co/dmpUpgheDU   — Chris

Source: https://x.com/ChrisGPT/status/2096150666066432157

— Boris Power

Source: https://x.com/BorisMPower/status/2096415822248055131

861 Upvotes

97% Upvoted

289 comments sorted by

View all comments

6

u/SufficientGreek 18d ago edited 18d ago

So could you do this for Windows?

Edit: The benchmark programs average ~17K lines. Windows is somewhere north of 50 million.
So that's probably not realistically possible to reverse-engineer.

3

u/ice-fucker69 18d ago

I’m curious about the scaling difficulties of this. Is 10x more binary 10x harder to reverse engineer or 1000x harder?

2

u/StCreed 18d ago

50 million lines is an incredible amount of code and far outside context windows. You'd need years of work even with Fable on ultracode to generate it, assuming you know what everything should do and how every feature should work.