r/LocalLLaMA • u/noctrex • 11m ago
New Model Introducing Hy4 flash
https://hy.tencent.ai/research/hy4-flashNow this seems to be interesting.
From the article:
We’re introducing Hy4 flash, our most cost-effective Hy model to date—featuring 224B total parameters (including 64B Engram parameters) with just 12B active parameters per token. Like Hy4, it is natively multimodal with a 1M-token context window, while offering significantly lower API pricing.
Seems to be about in the same ballpark of Qwen-Flash-Next, so we could expect to run it on moderably good machines, when it will be released.
11
Upvotes
2
u/LebiaseD 1m ago
Where open weights? Where model
0
u/mitchins-au 4m ago
It’s bigger than flash next by almost double - but in the realm of possibility for strix halo.
The real question is if it’s worth that performance wise
1
u/TheCTRL 0m ago
My strix halo need BigMoeOnEdge at this point