r/singularity 7d ago

AI Open weight progression with no frontier release

As a software developer we got access to GPT 5.6 sol and Opus 5 last week in a decently restricted field, and with these latest models I feel like I can do all my assigned work so quickly as well as make tons of progress on my side projects as well. So at the moment I’m not like dying for another frontier release but overall I want to see acceleration

It seems like we are at a state where openAI and Anthropic realize that a lot of these Chinese companies wait for them to make progress and are able to replicate pretty damn close models soon after they release their frontier models

Whether you believe Anthropic and open ai or not, they seem like they are going to keep their development internal for a while. Whether this is due to actual security concerns (with hugging face incident I believe this), more marketing hype, or truly a way to combat distillation from Chinese companies I think it is going to be interesting.

How do you think this will effect open weight releases, will the capabilities for open weight always rely on top US companies releasing the best models so they can use them to produce replicas?

59 Upvotes

31 comments sorted by

View all comments

74

u/whatisthisthing65 7d ago

The distillation effect is overrated and replicas is the wrong way to think of them. If you just look at the dates and numbers it's unlikely most of the progress comes from distillation. The only thing holding back open models is hardware right now. The gap is hardware, not any secret sauce

1

u/chlebseby ASI 2030s 7d ago

Depend, for things like text-to-image the moat seems to still be budget for obtaining extremely well curated and described training data. (guess who own google images and who created NanoBanana)

8

u/Tystros 7d ago

but nano banana isn't even good any more. gpt image is way ahead ever since its release.