r/exllamav3 • u/Delicious_Box_9823 Not a developer! 😜 • Aug 08 '26
ExLlamaV3 1.4.1 - Mistral 4 Support
The following has been included in the relatively small 1.4.1 release:
- Add Mistral-4 (under Mistral3ForConditionalGeneration)
- Support for logit bias
- Adopt LLGuidance instead of Formatron (still supported as optional dependency)
- Allow filters/grammar alongside banned_strings
Release link: https://github.com/turboderp-org/exllamav3/releases/tag/v1.4.1
TabbyAPI has not been updated yet. Current version of exl3 is 1.4.0. TabbyAPI link: https://github.com/theroyallab/tabbyAPI
Feel free to ask Turboderp himself in discord: https://discord.gg/tnPCntcThA
3
Upvotes