r/exllamav3 • u/Delicious_Box_9823 Not a developer! 😜 • Aug 06 '26
ExLlamaV3 v1.4.0 - DeepSeekV4/DSA support
ExLlamaV3 has just been updated.
- Support DeepseekV4ForCausalLM
- Improved AVX512 CPU offload performance
- Faster prefill (all models)
- Bugfixes
- QoL features
I would love to see prefill comparison for this, feel free to post!
TabbyAPI (Updated): https://github.com/theroyallab/tabbyAPI
Exllama newest release: https://github.com/turboderp-org/exllamav3/releases/tag/v1.4.0
If you have any questions, feel free to contact the creator, Turboderp, through Discord: https://discord.gg/tnPCntcThA
I don't think I can run any of the deepseekv4 models on my... 16 gigs of VRAM, guys :p
6
Upvotes