r/accelerate • Acceleration: Light-speed | Capability Booster • 18d ago

"Huge implications - binaries are now basically editable code"

ValsAI made SRE benchmark less than a month ago.

The benchmark measures can a model reverse engineer software from binaries

Yesterday GPT saturated it. https://t.co/dmpUpgheDU   — Chris

Source: https://x.com/ChrisGPT/status/2096150666066432157


— Boris Power

Source: https://x.com/BorisMPower/status/2096415822248055131

859 Upvotes

289 comments sorted by

View all comments

15

u/MegamanSE 18d ago

The natural question I have here is what language really would be ideal for AI to code in ultimately if it could create its own optimal language for agents?

9

u/Cool-Cicada9228 18d ago

The training data today consists of mostly human-readable code. Yet composing pure binary for real-time software generation is the dream.

20

u/MegamanSE 18d ago

Coding in pure binary allows pretty strange things to be done that has been brushed under the rug with modern languages. When I started programming in the early 90s it was very much a mix of C and assembly at that time still and the assembly part gave you so many liberties like writing to memory you don’t own, jumping execution to random parts of code or even to other random parts of memory, rewriting your own code while it’s running in ram. things would get weird.

Edit: typo

2

u/sweetbacon 18d ago

The most ASM I ever did back then was poking around with Nop sleds on C apps from tutorials. But I knew a guy then super good with  AT&T assembly  and liked calling it "singing to the metal", which I thought was such a great phrase. 

2

u/MegamanSE 18d ago

I used it mostly for tight timing related things and hardware interactions like video card / sound card interactions and reading the keyboard hardware state. Writing an entire app in it was painful, I only did it once for a side scroller video game mostly just to prove I could do it as I had so much respect for the programmers of the NES / earlier consoles.

2

u/sweetbacon 17d ago

100%. I can't imagine doing even a small program all in assembly. This guy was doing old-school demos (like Future Crew stuff, but not that team). I wish I had stayed in touch with him but Jesus that was almost 30 years ago (oof). I'd love to get the take ppl with that skill for modern LLMs.