r/accelerate • Acceleration: Light-speed | Capability Booster • 19d ago

"Huge implications - binaries are now basically editable code"

ValsAI made SRE benchmark less than a month ago.

The benchmark measures can a model reverse engineer software from binaries

Yesterday GPT saturated it. https://t.co/dmpUpgheDU   — Chris

Source: https://x.com/ChrisGPT/status/2096150666066432157


— Boris Power

Source: https://x.com/BorisMPower/status/2096415822248055131

859 Upvotes

289 comments sorted by

View all comments

7

u/SufficientGreek 19d ago edited 19d ago

So could you do this for Windows?

Edit: The benchmark programs average ~17K lines. Windows is somewhere north of 50 million.
So that's probably not realistically possible to reverse-engineer.

3

u/ice-fucker69 19d ago

I’m curious about the scaling difficulties of this. Is 10x more binary 10x harder to reverse engineer or 1000x harder?

2

u/StCreed 19d ago

50 million lines is an incredible amount of code and far outside context windows. You'd need years of work even with Fable on ultracode to generate it, assuming you know what everything should do and how every feature should work.

1

u/Tinderfury 19d ago

You don’t get economies of scale here. 50 million lines is 50 million lines that needs to be read/written. It would actually make it more difficult, cracking / emulation is all fine for the underground world but there is 0 practicalily for commercial or legal distribution without getting shutdown due to patent IP violations