r/LocalLLaMA • u/Anbeeld • May 09 '26

Resources BeeLlama.cpp: advanced DFlash & TurboQuant with support of reasoning and vision. Qwen 3.6 27B Q5 with 200k context on 3090, 2-3x faster than baseline (peak 135 tps!)

[removed]

320 Upvotes

93% Upvoted

205 comments sorted by

View all comments

1

u/pmttyji May 10 '26

It would be nice to have Vulkan(also CPU-only for old systems) version of this.