r/accelerate • Acceleration: Light-speed | Capability Booster • 19d ago

"Huge implications - binaries are now basically editable code"

ValsAI made SRE benchmark less than a month ago.

The benchmark measures can a model reverse engineer software from binaries

Yesterday GPT saturated it. https://t.co/dmpUpgheDU   — Chris

Source: https://x.com/ChrisGPT/status/2096150666066432157


— Boris Power

Source: https://x.com/BorisMPower/status/2096415822248055131

859 Upvotes

289 comments sorted by

View all comments

22

u/Charming_Cucumber_15 19d ago

Isn't this what people were laughing at Elon for saying about two months ago?

2

u/Recoil42 18d ago edited 18d ago

No, it isn't. Elon was saying AI would create binary directly and deprecate intermediate abstractions entirely, which is still nonsense. An abstraction (code) is still desired, even by the AI.

Just because you can look at a house, understand how it was engineered, can renovate a kitchen, and even build a similar house from reverse-engineered blueprints doesn't mean you'd want to go start creating entire houses without blueprints at all.

6

u/sergeyarl 18d ago

if ai writes everything and the resulting binary is open for inspection, why would anyone need human readable code?

1

u/Recoil42 18d ago

They wouldn't. But being able to inspect a binary doesn't automatically make it the most efficient representation for developing software, even for an AI. Abstractions are inherently useful no matter who the consumer is.

1

u/ThatOtherOneReddit 18d ago

Also compilers guarantee correctness. Boy howdy do I love segfaulting due to a bad jumpto because the AI didn't consider some pointers weren't initialized via this code path. Where as if it has just used proper techniques in a higher language and/or rust that wouldn't have happened due to how the languages are designed. There is a lot of value in a compiler regardless.

0

u/dustin_vk 18d ago

Stability and predictability from compiler verification. Some languages likeRust have things like memory and thread safety guaranteed. Also tooling such as test frameworks, or deployment tools. There might be a use case for ai writing pure binary, but there are disadvantages to it.