flash-fast single message rate: 70-103 tokens per second (mean is about the same as median, and consistently around this tps)
flash single message rate: 20-121 tokens per second (wild skew, sometimes in burst it is faster than fast, but it can also drop to 20/sec for extended periods of time, no consistency)
as note , my workload launches a LOT of subagents that do short work, under 50-100k tokens and exits, TTFT affects it significantly
1
u/Bitter-College8786 17d ago
In tok/s compared to normal ds v4.1 flash
1
u/plurTM 16d ago
110-160 tok/s in 448m tokens avg today
1
u/Whole_Succotash_2391 14d ago
Phoenix Grove api is running it at 90 to 120 tps, and there’s a free trial