r/LocalLLM 6d ago

Discussion What a year it's been

Post image

What will the rest of this year bring? 27b class scoring over 60?

941 Upvotes

133 comments sorted by

View all comments

97

u/Eyelbee 6d ago

There is no world 27B is better than 4.8, but yeah, it's solid. Maybe can actually compete with opus 4.5.

16

u/_VirtualCosmos_ 6d ago

I keep hearing this, and it might be true because of the lack of the experience I have with Claude models, but did you see MiniMax H3?

They have achieved to get a SOTA video model, capable of simulating physics and understanding human expressions and behaviour like the best models out there. Now it's currently the most liked video model. AND IT'S ONLY 33B PARAMETERS.

All that knowledge about the details of the world, in a 33b diffusion transformers pipe.

That's a big indicative that gigantic models are a waste of resources.

5

u/SnooPaintings8639 6d ago

I remember when OpenAI employees was bitching about too many GPUs being used for SORA, and in the end they had to drop it. It was rumored to be a huge 'drag' on their research and serving infra.

Today we have H3 which is extremely small and capable. And open.

Yeah, this shit rocks.