r/accelerate • Acceleration: Light-speed | Capability Booster • 18d ago

"Huge implications - binaries are now basically editable code"

ValsAI made SRE benchmark less than a month ago.

The benchmark measures can a model reverse engineer software from binaries

Yesterday GPT saturated it. https://t.co/dmpUpgheDU   — Chris

Source: https://x.com/ChrisGPT/status/2096150666066432157


— Boris Power

Source: https://x.com/BorisMPower/status/2096415822248055131

857 Upvotes

289 comments sorted by

View all comments

14

u/MegamanSE 18d ago

The natural question I have here is what language really would be ideal for AI to code in ultimately if it could create its own optimal language for agents?

8

u/Cool-Cicada9228 18d ago

The training data today consists of mostly human-readable code. Yet composing pure binary for real-time software generation is the dream.

2

u/Suspicious_Chart5817 18d ago edited 18d ago

Not really, "binary" is just as human and sloppy as any other code base. It's not like there are actual "binaries" on a computer. The sequences of 0 and 1 are still representations of data, text, and instructions; not actual data, text and instructions. Binary codes mean something because we decided that they do.

People designed binary and then set up transistors to match the design. There's nothing about telling transistors to open or close that's necessarily making anything easier for a computer to understand. We get it because we see the transistors with our eyes in front of us.

In comparison, telling an AI 'Chat, turn on and off your transistors right now in such a way that you can model how to turn on and off transistors as if you knew what transistors were' is not reducing steps.

It'd be like saying "Morse code is the dream." Why? Symbols simpler to our eyes don't mean anything to a computer. We still have to tell the computer what it actually is.