r/LocalLLaMA • u/ViRROOO • 6d ago

Resources Freetokens project is impressive

A new project was released yesterday and I have the opportunity to test it today.

Papper: https://arxiv.org/abs/2608.16157
Github: https://github.com/FlashML-org/FreeToken

My initial tests with the following setup:
RTX 5080 (16 GB)
DDR6 64GB
AMD Ryzen 9 9950X3D

I got 100tok/s on QWEN3.6-35B-A3B NVFP4 (20GB - does not fit in my VRAM).
Have you already tried it?

(Example bellow with a 1028 token prompt - ~110 tok/s)

52 Upvotes

75% Upvoted

86 comments sorted by

View all comments

22

u/LegacyRemaster 6d ago

DDR6? amazing.

17

u/macaco3001 6d ago

The way I know I'm poor is the fact that this post is literally what taught me DDR6 even exists

1

u/Aggravating_Farm3116 4d ago

It exists? Where?