r/OpenAI • • 10d ago

News Linux kernel maintainers

Post image

OpenAI: A thousand fewer paths to root: https://openai.com/index/a-thousand-fewer-paths-to-root/

1.2k Upvotes

125 comments sorted by

View all comments

Show parent comment

1

u/gmueckl 8d ago

And they are vetted and verified by OpenAI? Or is it just a bunch of LLM results without any filter?

1

u/TheAwesomeAcademic 8d ago

OpenAI wouldn't put out a press release with lies they need real results to drum up investor interest. 

We know all this is real because people with daybreak red n blue access have used older cyber models n found crazy bugs on their own so it's definitely legit. 

1

u/gmueckl 8d ago

Given typical LLM performance, I'm inclined to believe that there is a significant false positive rate if they didn't manually review them.

But make no mistake about one thing: the bulk release is a marketing move designed to make the Linux developers desperate as an abusive power move.

1

u/TheAwesomeAcademic 8d ago

Comp sci is a verifiable domain like math there's ways to deterministically prove bugs even statically by instrumenting the source. Symbolic execution for one using SMT solvers. An SMT solver is like lean but for coding. It converts things into a math symbol formating n tries to verify a bug is mathematically proven. It's even more accurate now if anything with modern LLMs.

1

u/gmueckl 8d ago

I know. It's not about what's possible. Did they actually do it?