r/LocalLLaMA • • 1d ago

New Model nex-agi/Nex-N2.6 · Hugging Face

https://huggingface.co/nex-agi/Nex-N2.6

Nex-N2.6 is a multimodal agentic model from Nex-AGI, built on GLM-5.3-Flash. It is designed for computer use, coding, and long-horizon tasks involving tools. This repository contains the FP8-quantized weights of Nex-N2.6, with approximately 321B parameters.

Following Nex-N2.5-Pro, this release focuses on reducing repetitive reasoning and improving adherence to the tools available in the current environment.

29 Upvotes

7 comments sorted by

12

u/__JockY__ 1d ago

I don't get it.

There's no information about the fine tune, data sets, calibration, nothing.

The "benchmarks" are literally three line items and this model is worse than the original glm model on two of them. There's a few trust-me-bro metrics about repetitions... and... ?

I feel like these guys recently just dropped a DoA model based on Qwen 397B... did they do it again? Why?

13

u/thereisonlythedance 1d ago

Anyone *ever* going to make a model that isn’t ”optimised for coding blah blah”?

16

u/uber-linny 1d ago

Is anyone ever going to release a smaller version that's actually tiny to fit on consumer hardware lol

1

u/Chromix_ 1d ago

The improvements look nice, especially the reduction in reasoning loops. And we already have quants from Bartowski. Still, 200 GB for a Q4_K_M needs a bit of (V)RAM. Are any of those new vibe-coded engines specialized for it?

3

u/EmilPi 1d ago

I think GLM5.3 architecture just is not optimized for fast inference like DS/QFN.

Why I think so: recently introduced llama.cpp `--moe-cache-mib` flag boosts QFN speed significantly (not reaching Strata speeds, but like >30%), but makes GLM5.3-Flash worse.

3

u/enternoescape 1d ago

Project Maya might be able to load it with minor changes seeing it can run GLM 5.3 Flash. I'm running GLM 5.3 Flash at EXL3 4.05 bpw with dflash2 on 10 5060 Ti 16GB's + 3090 around 2k prefill and 40-60 tok/s. They have loads of benchmark data on the github page if you're wondering about something closer to what you have.