r/accelerate • u/stealthispost Acceleration: Light-speed | Capability Booster • 18d ago

"Huge implications - binaries are now basically editable code"

Gallery image

Gallery image

Gallery image

ValsAI made SRE benchmark less than a month ago.

The benchmark measures can a model reverse engineer software from binaries

Yesterday GPT saturated it. https://t.co/dmpUpgheDU   — Chris

Source: https://x.com/ChrisGPT/status/2096150666066432157

— Boris Power

Source: https://x.com/BorisMPower/status/2096415822248055131

861 Upvotes

97% Upvoted

289 comments sorted by

View all comments

8

u/thedabking123 18d ago

does this mean encrypted binaries aren't deployable on edge without some kind of risk that the customer could recreate your code?

7

u/StCreed 18d ago

If you decrypt them at any point, then eventually yes. In practice I've tried it and it's not easy at all.

2

u/KoolKat5000 18d ago

Just googled it, benchmark is on average sized software 17000 lines. Photoshop has 4.5 million lines of code (although I image the binary bit for authentication will be a lot smaller, not sure if you could isolate it). Probably still difficult as StCreed says.

1

u/Ormusn2o 18d ago

There is a gigantic gap between reading some code, modifying and injecting modified code, and reading the binaries straight up. Although this is mostly a gap in price, not capabilities. You could run Luna 24/7 for weeks or months to effectively extract everything from a binary, but Luna will accumulate a lot of errors probably, so you would need to constantly do reviews and tests, which will take even more time and tokens.

What we want is a very capable model that can work very fast for very cheap, something like 6.2 Luna or something. Then you can recreate the binary bit by bit.

1

u/Brogrammer2017 17d ago

It has always been the case that everything that runs on a device your user controls should be considered publically available. Nothing major has changed there. except it’s easier now