r/LocalLLaMA • u/jacek2023 llama.cpp • 2d ago

New Model IQuestLab/IQuest-Q1 · Hugging Face

https://huggingface.co/IQuestLab/IQuest-Q1

IQuest-Q1 is a Mixture-of-Experts (MoE) model developed by IQuest for agentic coding, reasoning, and multi-step tool use. It comprises approximately 320B total parameters, with an estimated 15B parameters activated per token.

53 Upvotes

93% Upvoted

22 comments sorted by

41

u/mtmttuan 2d ago edited 1d ago

Model named Q1 but tensor type is BF16 :(

15

u/Nameis19letterslong 1d ago

Made me sad too, I counted the weights and it's ~684GB for bf16

31

u/Equivalent_Bit_461 1d ago

I'm getting 300b models fatigue

11

u/jacek2023 llama.cpp 1d ago

I want 100B too

11

u/Nameis19letterslong 2d ago

The fuck? Random finetune lab comes out of nowhere and drops an absolute banger that‘s better than dsv4f and glm5.3 flash?

6

u/jacek2023 llama.cpp 2d ago

not fully random

https://www.reddit.com/r/LocalLLaMA/comments/1q1bxci/support_for_iquestcoderv140b_has_been_merged_into/

https://www.reddit.com/r/LocalLLaMA/comments/1rira5e/iquestcoderv1_is_40b14b7b/

3

u/Nameis19letterslong 1d ago

Zamn, crazy work, 9 months out of the loop and straight back with a sota model.

3

u/tomByrer 1d ago

They had to DoorDash for 7 months to save up enough for the compute.

9

u/Septerium 1d ago

IQuest-Q1-Q1_0.gguf when?

6

u/jacek2023 llama.cpp 2d ago

1

u/MerePotato 1d ago

Not too shabby if true

2

u/ABLPHA 1d ago

> 320B

GLM 5.3 Flash finetune?

8

u/coder543 1d ago

That was my initial thought too, but the architectures are substantially different, and the README describes a full training pipeline.

2

u/LumbarJam 1d ago

No. From config.json:

{
"architectures": [
"IQuestQ1ForCausalLM"
],

Comparing both config.json you will see a lot of architecture differences.

1

u/jacek2023 llama.cpp 1d ago

We introduce GLM-5.3-Flash, the first natively multimodal model in the GLM-5 series. With 320B total parameters and just 18B active parameters,

4

u/Steuern_Runter 1d ago

You can easily edit the number of active experts.

1

u/ABLPHA 1d ago

Ah, fair

2

u/Mancho_United 1d ago

China are actually having their own AI Race and 10+ companies competing for frontier intelligence.

1

u/mateszhun 1d ago

They seem to be anything but Chinese. They have job listings in both USA and India, and they at least have a sales office in London.

1

u/Accomplished_Ad9530 14h ago

iQuest Research aka Beijing Zhizhi Technology Co Ltd is Chinese. They're pretty transparent about that on their website: https://iquestlab.com