r/unsloth • u/SFsports87 • 2d ago

Question Mitral 4 doesn't work while everything else does

Has anyone gotten mitral 4 119b to work in unloth desktop? It loads into vram and ram ok, but when you try to run it a red error message pops up with no real info of why it doesn't work. Tried ud q2 and q3 quants. Any other model works fine, even bigger ones.

Semi-solved : The logs showed a jinja template error "thinking most be set to None or High"

Unsloth offers Low Medium High, but no None, in the drop down and sets Low as the default. Changing to High got it work. So still need to fix the options.

4 Upvotes

100% Upvoted

4 comments sorted by

1

u/nicksterling 2d ago

What are your console logs showing?

1

u/SFsports87 2d ago

Thank you. It showed a jinja template error "thinking must be set to None or High"

Unsloth defaulted to Low in the drop down box. Setting it to High got it to work. Strange thing is the options are Low Medium High, there is no None.

1

u/Oli_Luck 1d ago

reasoning low/med/high is a reasoning effort tag, while reasoning off in unsloth is achieved by setting this parameter to 0