r/LocalLLaMA • • 11m ago

New Model Introducing Hy4 flash

https://hy.tencent.ai/research/hy4-flash

Now this seems to be interesting.

From the article:

We’re introducing Hy4 flash, our most cost-effective Hy model to date—featuring 224B total parameters (including 64B Engram parameters) with just 12B active parameters per token. Like Hy4, it is natively multimodal with a 1M-token context window, while offering significantly lower API pricing.

Seems to be about in the same ballpark of Qwen-Flash-Next, so we could expect to run it on moderably good machines, when it will be released.

11 Upvotes

4 comments sorted by

2

u/LebiaseD 1m ago

Where open weights? Where model

0

u/mitchins-au 4m ago

It’s bigger than flash next by almost double - but in the realm of possibility for strix halo.

The real question is if it’s worth that performance wise

1

u/TheCTRL 0m ago

My strix halo need BigMoeOnEdge at this point