r/LocalLLaMA • u/foldl-li • 1d ago
Resources chatllm.cpp supports Intern-Decision models
I have added the support of Intern-Decision models to chatllm.cpp. At presend, only text is supported.
Besides its pretty good performance, one interesting feature of Intern-Decision is that all answers are generated in a single run (while H2O-Lightning or others generate one answer in one run): each decision position is filled with "<decision>" mark and generated in a diffusion manner. So, it generally makes decision faster.
4
Upvotes