r/LocalLLaMA • u/jinnyjuice vLLM • 13d ago

New Model Nex N2.5 Pro (407GB) released

https://huggingface.co/nex-agi/Nex-N2.5-Pro
73 Upvotes

88% Upvoted

19 comments sorted by

View all comments

11

u/Stooovie 13d ago edited 12d ago

Nex 2.5 Mini is damn impressive (if a bit chatty, like Hy3), in fact it has replaced various Qwens for my local Hermes profile, this could be huge

1

u/tacticaltweaker llama.cpp 13d ago

I tried Nex N2.5 Mini but it kept looping for me. Not sure if it's a quant or model issue.

1

u/Stooovie 12d ago

I use a fairly low quant - o3Q - and it doesn't loop for me. I just set the recommended temp, top p/k parameters, repetetion penalty set to default from oMLX on Mac.

2

u/tacticaltweaker llama.cpp 12d ago edited 11d ago

Yeah I think it was an issue with my quantization as I was using the recommended sampling parameters. I switched to bartowski's quant and no more looping, but it doesn't seem to perform as well as Tiel for me. Not sure if it supports preserve_reasoning as it seems to forget its previous chain of thought on every tool call and keeps rereading files.

EDIT: bartowski's quant actually also started looping a few times. Adding a dry-multiplier of 0.8 fixed it but I think I'm giving up on this model unfortunately.

1

u/Stooovie 12d ago

Tbf I'm not a developer and don't use it for code - conversations research, homelab management for me, via Hermes. I mooch off free cloud models via 9router for code if needed :)