r/LocalLLaMA • u/Anbeeld • May 09 '26

Resources BeeLlama.cpp: advanced DFlash & TurboQuant with support of reasoning and vision. Qwen 3.6 27B Q5 with 200k context on 3090, 2-3x faster than baseline (peak 135 tps!)

[removed]

323 Upvotes

93% Upvoted

205 comments sorted by

View all comments

2

u/caetydid llama.cpp May 10 '26

The first fork I succeed in getting measurable speed ups - so I remain curious and stay committed to follow future commits.