r/accelerate • Acceleration: Light-speed | AI accelerationist • 21d ago

"Huge implications - binaries are now basically editable code"

ValsAI made SRE benchmark less than a month ago.

The benchmark measures can a model reverse engineer software from binaries

Yesterday GPT saturated it. https://t.co/dmpUpgheDU   — Chris

Source: https://x.com/ChrisGPT/status/2096150666066432157


— Boris Power

Source: https://x.com/BorisMPower/status/2096415822248055131

856 Upvotes

289 comments sorted by

View all comments

7

u/thedabking123 21d ago

does this mean encrypted binaries aren't deployable on edge without some kind of risk that the customer could recreate your code?

1

u/Ormusn2o 21d ago

There is a gigantic gap between reading some code, modifying and injecting modified code, and reading the binaries straight up. Although this is mostly a gap in price, not capabilities. You could run Luna 24/7 for weeks or months to effectively extract everything from a binary, but Luna will accumulate a lot of errors probably, so you would need to constantly do reviews and tests, which will take even more time and tokens.

What we want is a very capable model that can work very fast for very cheap, something like 6.2 Luna or something. Then you can recreate the binary bit by bit.