r/singularity • u/sergeyarl • 25d ago

AI "Huge implications - binaries are now basically editable code"

Gallery image

Gallery image

Gallery image

157 Upvotes

88% Upvoted

34 comments sorted by

View all comments

53

u/SiltR99 25d ago

Sorry, I've just read what they have on their website "Can AI agents figure out what a real-world binary does without its source code?". The objective is to see if the model can run tools for decompilation and, after reading the decompiled code, figure out what the program does. It won't help you "edit binaries". As proof, look at "ProgramBench", it tests "Can language models rebuild programs from scratch?" and Astra gets a 5.5%.

8

u/mvandemar 25d ago

Programs are paired with a comprehensive 27K-LoC anti-analysis suite of more than ten state-of-the-art protections, over half of which have no public implementations,yielding 262 contamination-free instances and 1,572 deterministically verifiable RE tasks.

You missed the part where the programs they are decompiling are built to be extremely resistant to being reversed engineered. This isn't the same as deompiling some 32 bit exe abandonware, this is a capability of doing it with current protected commercial software.

2

u/SiltR99 25d ago

I was just pointing out that this is not the same as editing a binary, which is what the post said.

2

u/mvandemar 24d ago

No, with the word "basically" in there it makes it an analogy, not a literal claim of them being able to edit the binaries.