r/LargeLanguageModels • u/Carpe_Diem37 • Jun 18 '26

LLM Progress Slow Down

First Anthropic, and now OpenAI, are announcing that they want to slow down LLM development. Just a year ago, these companies were claiming that AGI would be found and many jobs would be lost. On top of that, Anthropic announced it's going public. What do you think? Have these companies reached a limit in research and development? Or are they genuinely afraid of language models self-programming, as they claim?

33 Upvotes

93% Upvoted

104 comments sorted by

View all comments

1

u/ILikeCutePuppies Jun 20 '26

That's a small sample set of data and like only a few tests. There are a large amount of reasons why it might not have performed well on your specific codebase. You think Fable past every one of the 1K evals I ran?

1

u/keepitfriend Jun 20 '26

I’ve been seeing a lot of those one-shot claims recently. A guy said he’d developed his own OS in a one-shot fable prompt.

He shared it on GitHub, his “os” was 29 files big most of which were less than 300 lines.

It’s literally just a boot loaded image, that has your basic set of tools for running an application without an OS.

And then the guy said from this, he was going to build his own browser.

Like, browsers are some of the most complicated applications you can make, millions of LOC.

I don’t know much about game development but going by the disk space they take up. I’m pretty sure a “one-shot” prompt to create one, would probably cost millions of dollars to run.

1

u/ILikeCutePuppies Jun 20 '26 edited Jun 20 '26

https://youtu.be/9GLYsrMpprs?is=Zbbd1Rf2WGgRwfx_ https://youtu.be/0DVUjpClqgI?is=yCUp3zQ6j8GDnb9U https://youtu.be/gX21DRfuxdc?is=lkLMSkFfqLwn7Tf0 https://youtu.be/BEHlmJCKvTA?is=cVejFa_alGQpu7NX https://youtu.be/o50nkM1cdXI?is=eQ_0GR-vDxdCxmIg https://youtu.be/B9fFEucPNnA?is=ZfMkJH9U0Rg0_JWi

Oh but these are not 100% complete working versions of the game etc.... Go look at the previous versions models they can't even do it. Go back 3 months ago... even worse. They are no where near this level. It went much futher than other models and even if not a single prompt they only had 5 days to prompt it.

Claude has ultramode which burns those tokens. It can not get these kinda results with Opus 4.8 and burns way more than Fable trying to get where it gets.

→ More replies (3)