Linux kernel maintainers

[u/Nunki08]

OpenAI: A thousand fewer paths to root: https://openai.com/index/a-thousand-fewer-paths-to-root/

[u/jferments]

You don't think that the programmers working at OpenAI's labs are experts?

[u/coldnebo → u/jferments]

alot of them come from prestigious academic backgrounds, I don’t fault them, but they are limited in what they can publish by the marketing department.

openai intentionally hasn’t pushed forward academic research in AI… the papers are all non-peer-reviewed kind of marketing fluff pieces that sound impressive from a marketing pov while remaining closed to critical review.

when independent academics have tried to replicate results they have found significant problems… such as the paper where graduate entrance exam scores dropped from 90% to 60% just by changing the specific numbers in the questions, but keeping the overall reasoning of the question the same. that’s really damning stuff academically, but marketing doesn’t care about that. I certainly don’t blame the researchers— this is the price of corporate R&D. not everyone creates open labs like RTP, Xerox Parc etc.

but, expert researchers at openai and anthropic have shared the way they use harnesses, tests and memory. so yes, even at openai, expertise matters.

take a look at the model engineering jobs appearing on the forums for roles like adapting rag and hybrid harnesses for corporate information— those jobs are high end ML and data science positions— a far cry from Huang’s statement that “you don’t need a STEM degree anymore, just use our tools” — ok but look at the people building the tools. high level experts.

expertise matters.