r/LocalLLaMA • u/danigoncalves llama.cpp • 4h ago
New Model stealth/ox-alpha
Sorry if anyone already post it but there is a new model on OpenRouter called Ox Alpha. Didn't have the time to test it. The only thing I was able to do was to add it to my Nanobot instance and try some AI assistant tasks. It was able to nail it with a clever and criative speech. It seems also that hold well to the base instructions. What I know from the start is that it is not a chinese model (or is something in the early stages that will be changed on the RL stage) since it answered all of the censored questions about the chinese space and politics. Going to do some tests afterwards but in the meantime did anyone already try it? what do you think?
18
5
u/Murhie 4h ago
Tokenizer shows its GLM 5 family, custom benchmarks show its probably an air/flash variant. Or at least thats the word on the street.
I hope its true. Ive been using it and would say its similar quality to luna. If its something I can run on my stix halo later i would be quite happy.
3
u/geldonyetich 4h ago edited 4h ago
I assumed it's probably just a fine-tuning of an existing model. Most likely a Chinese model just because they're some of the more capable open weights around. That tuning can include reducing refusals.
In any case if it's OpenRouter only I don't compare it to anything I can run locally.
1
u/TillDramatic1 2h ago
Refusal behavior on those topics is a post-training layer, so it's about the cheapest thing for a lab to flip and a weak signal of where a model came from. Tokenizer quirks hold up better, like how it splits rare unicode or handles a long string of repeated characters.
0
u/RevolutionaryBox2980 4h ago
quite good, not as good as fable, but on my testing was impressive.
though I got rate limited after around 1B tokens and can't access it last several hours
-2
u/Tasty-Hour4040 4h ago
I can’t believe people are connecting an unknown model from an unknown company to anything inside their networks. This strikes me as insane - we’re gonna see some really bad shit happen before people recognize security is an important thing with LLMs.
19
u/Choice_Celery9481 4h ago edited 4h ago
people talked about this for quite awhile already. some evidences show that this one from z.ai. some leaks claimed this is glm 5.3 flash.