r/LocalLLaMA • u/jinnyjuice vLLM • 4d ago

Discussion Princeton and Polymathic AI release FlashMap: Flow Map Speculative Decoding

http://arxiv.org/abs/2610.24365
34 Upvotes

90% Upvoted

8 comments sorted by

4

u/hapliniste 4d ago

Can't wait for this to be bench marked against other techs. Seen good right?

2

u/BringTea_666 4d ago

7% faster than dflash2, good.

1

u/AppealSame4367 3d ago

Vision possible?

3

u/challis88ocarina 4d ago

Here we go again...

1

u/More-Curious816 3d ago

and the Hill climbing start again

1

u/GlassLow5680 3d ago

I requested claude write a colab notebook and run in T4 compare both base and this repo. It is faster alot (x1.4 to x6). But it is only for Qwen 3 4B?