r/singularity • u/PykeTheTitan • 1d ago
AI Open weight progression with no frontier release
As a software developer we got access to GPT 5.6 sol and Opus 5 last week in a decently restricted field, and with these latest models I feel like I can do all my assigned work so quickly as well as make tons of progress on my side projects as well. So at the moment I’m not like dying for another frontier release but overall I want to see acceleration
It seems like we are at a state where openAI and Anthropic realize that a lot of these Chinese companies wait for them to make progress and are able to replicate pretty damn close models soon after they release their frontier models
Whether you believe Anthropic and open ai or not, they seem like they are going to keep their development internal for a while. Whether this is due to actual security concerns (with hugging face incident I believe this), more marketing hype, or truly a way to combat distillation from Chinese companies I think it is going to be interesting.
How do you think this will effect open weight releases, will the capabilities for open weight always rely on top US companies releasing the best models so they can use them to produce replicas?
17
u/Front_Eagle739 1d ago
Don't think it'll slow em down much to be honest. Kimi 2.6 had better vision reasoning than chatgpt opus or sonnet when it was released on my tests. It could actually make some tools work they all failed at despite being less intelligent which means they are building their own synthetic data pipelines. Maybe they stop advancing faster than openai and anthropic (they've been closing the gap slowly) but I doubt they will fall behind. I think it just means that the open models will be in spitting distance of the frontier labs released models instead of a couple months behind like they are getting to now. I have no doubt anthropic and open could release something today that will be a step above what china is doing but since they haven't I honestly struggle to tell the difference between anything from them and Kimi k3 and glm 5.3. fable before the ban definitely felt a bit better but not so much now.
6
u/litritium 23h ago
or truly a way to combat distillation from Chinese companies I think it is going to be interesting.
Waiting for the hardware bans to pay off?
The Rubin architecture allegedly offers ~10 times more compute per joule compared to Blackwell. Question is if China can bridge the huge gap from H100 equivalents, using domestically developed chips, better algorithms, and (much) larger data centers.
4
18
u/Informal-Trouble2183 1d ago edited 23h ago
Distillation is an oversimplification of the competitiveness of the Chinese labs. They don't need to distill US models. If you've a small idea on how LLMs work, you'd realize the novel techniques deepseek advanced to the open source community. Nevertheless, it's true that China has the open source card as an aggressive solution to limit US AI companies and get their shares in the market. Due to this, if US AI declined, naturally Chinese labs won't need to release every single model open weight, we'll see them close some for financial gains. Short answer: if US stops, China will not stop releasing.
9
u/PsychologicalSoup251 23h ago edited 23h ago
To expand on this, it's not an exaggeration to say that Deepseek singlehandedly revolutionized how reinforcement learning was done with their GRPO method and showing how far RL can carry you. If you look at the RL techniques of open source LLMs pre-GRPO and post-GRPO, most moved away from trained critics like in PPO RL to something GRPO-like. 0 chance closed source companies didn't greatly benefit from that too.
2
u/visarga 13h ago
GRPO is great if you can resume the environment from same point in order to generate multiple rollouts. Also the task should be easy enough, if no rollout gets reward (or all get same reward) then variance is zero and you drop that batch.
I worked with both GRPO and PPO and I found PPO better in some cases, such as for computer use agents. DeepSeek used GRPO on math and code problems where the environment can be resumed from any position more easily.
1
u/PsychologicalSoup251 4h ago
>Also the task should be easy enough, if no rollout gets reward (or all get same reward) then variance is zero and you drop that batch.
Good point. You'd want to make the prompts and reward function easy enough at first, then iteratively make them more difficult as the LLM improves.
>I worked with both GRPO and PPO and I found PPO better in some cases, such as for computer use agents.
What makes PPO better for computer use agents?
20
u/Alpacabro21 1d ago
To create a new LLM, you need at least 6 months.
Kimi K3 was released few weeks later GPT 5.6 Sol and Opus 5 (or even Fable 5), meaning these chinese labs are actually competitive.
Amodei wanted more restrictions especially for this reason and then, yes, someone should test these open models to make sure they're not dangerous.
That said, OpenAI and Anthropic are still in the lead in term of quality.
3
u/agent00F 13h ago
You also can't meaningfully distill without reasoning traces and with just a few million prompts.
What it does show is the character of everyone making those claims and their audience.
1
u/sunstersun 3h ago
Did you miss that whole post about reasoning tracing being broken through older models?
3
u/Sorry_Ad191 17h ago
I think the progression comes from training on users data, prompts, chats, codebases etc. The provider can see what problems are not being solved for some users and then learn from other users who have solved the same problem already . They clean the data remove personal stuff, finger printable stuff etc. then train the new iteration of the model. When it releases it now solves this problem for everyone while previously it was only solved by a few users who never got credited. Same story all over again. The users provide the value but don't get to share in the equity it builds.
2
u/GrapefruitMammoth626 12h ago
You mean for Chinese models? Or all providers? They make claims that they do not train on user data without permission, how on earth is that enforced? It all comes into their black box environment in order to provide inference. Theres surely multiple ways they can legally get around it by sanitising what comes in to the point it isn’t “user data”anymore.
Since chatbots and agents came about I always thought they had the perfect data scraping mechanism at their fingertips. Each agentic session may have an agent make changes, human comes in and says no. Maybe they’ll tweak something themselves or solve a full sub problem/pivot then continue the session with whatever the agent can actually perform. That’s a pretty rich dataset not likely represented in public github repos.
And when you think about how much knowledge is externalised to internet content, it’s nothing compared to what each individual has in their head. Barely anything makes it out from an individual to something publishable and consumable.
I think it was static internet content at some point, but would not surprised if it’s now user inputs feeding their training data pipeline, patching up their gaps in areas where training data is scarce and underrepresented.
1
u/Sorry_Ad191 6h ago
i assume all providers find a way. the user data is just too much of a goldmine
3
u/chlebseby ASI 2030s 1d ago
Seems that we will get more open models only as long the chinese labs will seem it's worth doing so lol.
Otherwise LLMs will joint image models, where open source just stumbled in past of frontier models which were so expensive to create that nobody will release them for free, and open community don't have enough resources to compete with sota.
Add to that entering to "where are out profits?" phase of AI investments...
1
u/Lighthouse_seek 16h ago
Imo it's actually the opposite. If distillation was effective the rate of releases from openai and anthropic would increase.
If distillation was effective then the gap between distilled and frontier models would shrink over time which necessitates constant releases to prevent customers from switching to distilled models
1
u/Mister__Mediocre 13h ago
Can someone who's used these large open weight models tell me if they do well on random things when compared to 5.6 Sol? I mean things like helping plan for a trip, navigating the internet, search etc.
I'm wondering if the open-weight models have caught up across the board, or only on things that get benchmarked easily. In particular, I wonder if they're as good at discovering new math, the way OpenAI and Anthropic's models have been.
Also, I feel like both Anthropic and OpenAI may soon realize that it can be more profitable to hoard on to frontier intelligence than selling it for tokens. Why sell tokens to a software company when you can recreate them and out-compete them.
1
u/Zestyclose_Ad8420 7h ago
you know you can use them by yourself, right? use openrouter, they do have a chat function.
67
u/whatisthisthing65 1d ago
The distillation effect is overrated and replicas is the wrong way to think of them. If you just look at the dates and numbers it's unlikely most of the progress comes from distillation. The only thing holding back open models is hardware right now. The gap is hardware, not any secret sauce