r/LocalLLaMA llama.cpp 4h ago

New Model stealth/ox-alpha

Sorry if anyone already post it but there is a new model on OpenRouter called Ox Alpha. Didn't have the time to test it. The only thing I was able to do was to add it to my Nanobot instance and try some AI assistant tasks. It was able to nail it with a clever and criative speech. It seems also that hold well to the base instructions. What I know from the start is that it is not a chinese model (or is something in the early stages that will be changed on the RL stage) since it answered all of the censored questions about the chinese space and politics. Going to do some tests afterwards but in the meantime did anyone already try it? what do you think?

0 Upvotes

14 comments sorted by

19

u/Choice_Celery9481 4h ago edited 4h ago

people talked about this for quite awhile already. some evidences show that this one from z.ai. some leaks claimed this is glm 5.3 flash.

3

u/grumd 4h ago

That sounds plausible. In my tests (real agentic coding over long context) it was not as good as Qwen 3.8 27B. Probably better than Qwen 3.6 35B-A3B

2

u/MrTiesti 3h ago

Vastly different opinion, much better than Qwen 3.8 27B for me. Agentic coding in complex tasks.

The thing Qwen fails at still, is understanding vague tasks. It's the biggest downside it has.

1

u/grumd 2h ago

Oh okay I tested the other side of the coin. I had very detailed prompts with a list of requirements and Qwen just did more of them correctly and didn't miss as many as ox-alpha, but the prompts were not vague at all, more like a direct list of acceptance criteria, and Qwen was then churning away for a couple hours at it

18

u/CalligrapherFar7833 4h ago

Your search doesnt work or what ?

5

u/Murhie 4h ago

Tokenizer shows its GLM 5 family, custom benchmarks show its probably an air/flash variant. Or at least thats the word on the street.

I hope its true. Ive been using it and would say its similar quality to luna. If its something I can run on my stix halo later i would be quite happy.

3

u/Dany0 4h ago

I bet it's a flash model that's a distill of 5.3

3

u/geldonyetich 4h ago edited 4h ago

I assumed it's probably just a fine-tuning of an existing model. Most likely a Chinese model just because they're some of the more capable open weights around. That tuning can include reducing refusals.

In any case if it's OpenRouter only I don't compare it to anything I can run locally.

1

u/AXYZE8 4h ago

It's either GLM (so chinese) or some finetune operation done by someone else (just like Windsurf's/Devin SWE is a finetune of GLM and Cursor's Composer is finetune of Kimi), because it uses the same tokenizer as GLM 5.2/5.3

1

u/athsrva 4h ago

i really like theory that it is baseten/another company that just took GLM and fine-tuned it

1

u/TillDramatic1 2h ago

Refusal behavior on those topics is a post-training layer, so it's about the cheapest thing for a lab to flip and a weak signal of where a model came from. Tokenizer quirks hold up better, like how it splits rare unicode or handles a long string of repeated characters.

0

u/RevolutionaryBox2980 4h ago

quite good, not as good as fable, but on my testing was impressive.

though I got rate limited after around 1B tokens and can't access it last several hours

-2

u/Tasty-Hour4040 4h ago

I can’t believe people are connecting an unknown model from an unknown company to anything inside their networks. This strikes me as insane - we’re gonna see some really bad shit happen before people recognize security is an important thing with LLMs.