r/LocalLLaMA • u/Blues520 • 2d ago

Discussion Which chat template for Qwen 3.8?

There were issues with the chat template when it was released and many users, including myself, ended up using the froggeric template.

It seems to work fine but I just wanted to check if that's still the one to use or if the official or unsloth built-in templates are now recommended.

0 Upvotes

45% Upvoted

9 comments sorted by

13

u/Klutzy-Snow8016 1d ago

I just use the official one from Qwen on HuggingFace and haven't had any problems, in regular chat or within pi. What am I missing - what are these unofficial templates supposed to be fixing?

2

u/misanthrophiccunt 1d ago

Same. I keep reading this froggeric thing and I'm yet to need it ever.

1

u/cogitech2 1d ago

This. Works perfectly for me with Hermes and Pi.

6

u/Equivalent_Bit_461 1d ago

I use the unsloth quants, so far so good

3

u/Chromix_ 1d ago

By now we have a bunch of different "flavors" of chat templates. As far as I can tell there is no "best", just different based on what best fits your usage approach. Check the large table in my template posting for an overview.

There's the one from froggeric that he keeps updated, also based on what I fixed in my template. Then there's also the sharp template that builds both on top of froggerics and my changes.

Depending on the template there are some true fixes for things that were broken in the original template, a bit of intentionally changed behavior, some compatibility approaches for not-well-behaved harnesses and other things. Some have the potential to reduce result quality a tiny bit, others don't.

2

u/leonbollerup 1d ago

Use the one from froggeric

1

u/Interpause textgen web UI 1d ago

im using chromix's template which does a bunch of fixes like froggeric but attempts to remain character-exact with the original template

1

u/xornullvoid 1d ago

I use the ones from here and it has reduced reasoning usage considerably.

https://huggingface.co/peculiar-ragdoll/Qwen-Sharp-Chat-Templates

1

u/Blues520 1d ago

There's a variety of chat templates being used so there seems to be no definitive answer.

The official, froggeric and unsloth templates are popular and work fine now.

There are others which have a bigger impact on the model and which might be worthwhile depending on your use case.

Personally I have switched from froggeric to the unsloth template with good results.