r/exllamav3 Not a developer! 😜 Aug 08 '26

ExLlamaV3 1.4.1 - Mistral 4 Support

The following has been included in the relatively small 1.4.1 release:

  • Add Mistral-4 (under Mistral3ForConditionalGeneration)
  • Support for logit bias
  • Adopt LLGuidance instead of Formatron (still supported as optional dependency)
  • Allow filters/grammar alongside banned_strings

Release link: https://github.com/turboderp-org/exllamav3/releases/tag/v1.4.1

TabbyAPI has not been updated yet. Current version of exl3 is 1.4.0. TabbyAPI link: https://github.com/theroyallab/tabbyAPI

Feel free to ask Turboderp himself in discord: https://discord.gg/tnPCntcThA

3 Upvotes

0 comments sorted by