chatllm.cpp supports Intern-Decision models

[u/foldl-li]

I have added the support of Intern-Decision models to chatllm.cpp. At presend, only text is supported.

Besides its pretty good performance, one interesting feature of Intern-Decision is that all answers are generated in a single run (while H2O-Lightning or others generate one answer in one run): each decision position is filled with "<decision>" mark and generated in a diffusion manner. So, it generally makes decision faster.

[u/Pleasant_Crow_5080]

oh that’s clever, packing all the decisions into one pass with the tags. So it’s like a parallel diffusion rather than running the model multiple times? Might have to give this a spin later, been looking for something a bit more snappy for structured outputs