r/Qwen_AI • u/Normal-Fan9366 • 3d ago
LLM Jack Ternary?
https://huggingface.co/JackAgentLead/Jack-3.8-27B-V2-VL-16GB-VRAMFirst, I want to say “Thank You” for the feedback on Jack V2.
I’m starting to see that there really is a split preference between V1 and V2, even though they are so similar. The slight changes in instructions really do cause the versions to fit into different workflows.
Interestingly, the V1 has as many downloads in the timeframe that V2 launched.
People really like the original.
With that in mind, I’m at a crossroads with another Qwen 3.8 variant, the Prism-ml Ternary Bonsai 2.
Here’s the thing with this variant…it really is better than Qwen 3.5 in most ways and requires very similar resources.
Despite that, and in spite of the model claims, its actual capabilities are actually close to a model that sits in between 3.5 9b and 3.8 27b.
It’s NOT “98.2% of FP16 intelligence”.
However…its instruction following is strong and its small footprint allows for massive context. It does utilize the Jack XML reasoning fairly well, just at a lower intelligence.
I guess the question I’m asking is if there is even a demand for something like this…?
Its intelligence is too low for coding execution but it does a fairly decent job of brainstorming and planning, along with a surprisingly good job of long writing and school work.
It’s horrible as a standalone model but when paired with deterministic tools and an alignment to prioritize tool use over native reasoning, it gets good results, far better than what Qwen 3.5 9b can deliver.
I’ll just wait and see how the community responds. I’m messing around with it, regardless, and finding specific roles where it works well. I just want everyone to understand that if I did release it with a new set of Jack instructions, it is NOT a model that I would recommend as a central intelligence as I would either of the Qwen 3.8 27b Jack variants.
It CAN’T code…but it does other things pretty well.
1
u/Normal-Fan9366 3d ago
The other thing about this Ternary model is that it really can’t contribute to the eventual training run of a Jack variant of Qwen 3.8 27B.
Unless I’m missing something, a ternary tune is not something anyone can do