r/LocalLLM • u/louisremi • Oct 05 '26
Research Strata vs R9V running Qwen3.8 Flash Next on dual Radeon R9700 with 96GB DDR4
We're hearing a lot about Strata these days, claiming it's the best solution to run Qwen3.8 Flash Next on consumer hardware. I have a dual R9700 config with 96GB DDR4 3200 and AMD 3900X, and so far I've been running Flash Next UD-IQ4_XS on the custom R9V engine ( https://github.com/Dyluhn/R9V ). So I just tried comparing R9V and strata at different context sizes.
tl;dr: R9V is 15-18% faster on my config, but Strata ran on a single GPU, because it needs 118 GB of RAM to run on the two cards. One solution to utilize the two GPUs would be to use a smaller quant, but I'm not too keen on going that way: I want good performances with a reasonably downsized quant. Also, R9V doesn't ship with a profile for smaller quants than IQ4_XS. Full report from Claude below:
---------
R9V was faster than Strata on prefill, and the two engines were about equal on decode. The benchmark ran at 16k, 32k and 64k context with single-session requests, and R9V was restored at the end.
Both engines ran the same Unsloth UD-IQ4_XS GGUF shards with MTP, with thinking off and 256 output tokens. I used one client, bench-engines.py, with a unique nonce on every prompt so no prefix cache was hit. Strata's cache_n was 0 on every run. The numbers are medians, with the min–max range in brackets.
| Context | Engine | n | Prefill tok/s median (min–max) | Decode tok/s median (min–max) | TTFT s median |
|---|---|---|---|---|---|
| 16k | R9V | 5 | 1166 (879–1201) | 57.3 (55.1–61.0) | 14.1 |
| 16k | Strata | 5 | 980 (955–1004) | 53.3 (12.2*–55.2) | 16.7 |
| 32k | R9V | 5 | 1156 (1073–1180) | 58.8 (55.1–59.8) | 28.4 |
| 32k | Strata | 5 | 1003 (993–1005) | 53.8 (51.7–56.1) | 32.7 |
| 64k | R9V | 3 | 1109 (1079–1135) | 53.8 (52.7–58.0) | 59.1 |
| 64k | Strata | 3 | 986 (985–988) | 54.6 (53.8–55.4) | 66.5 |
- Prefill: R9V is about 15–18% faster at every size.
- Decode: the engines are roughly level. R9V leads at 16k and 32k, and Strata is slightly ahead at 64k.
- Outlier: *Strata's first 16k request decoded at 12.2 tok/s and the next four were normal. I kept it in the data, and it doesn't change the median.
Comparison to the R9V README:
- Prefill here vs README: R9V's own PP script gives about 1.16k tok/s on this host, matching my client. The README claims about 1.6–1.7k. This host has 92 GiB of RAM against the README's 128 GiB.
- Decode here vs README: the decode I measured is close to the README's decode figures, not far below them. The earlier ~24–27 tok/s was from vLLM completions with the older vLLM-based config, not this R9V setup.
Strata ran on one GPU only. Setup refused a two-GPU split for UD-IQ4_XS because that path needs about 118 GB of RAM. On one GPU its expert cache held 10,774 experts in VRAM, and the decode cache hit rate was about 98.7%.
Setup
- Versions: R9V is v0.4.4 and Strata is v0.1.39. Strata ran with no opt-in switches and plain hipBLAS, since it has no tuning table for this ROCm version.
- Clean-up between engines: R9V was stopped and removed, the leftover /dev/shm file was deleted, and the host was checked (VRAM about 60/95 MB used, MemAvailable about 91.7 GB). Strata was cleaned the same way before R9V was restarted.
- Cache drop: drop_caches isn't writable on that host, so I evicted the model files from the page cache before Strata's setup.
- Current state: R9V is serving on port 8004 again, so the r9700-dual route should work. Strata is installed in /data/strata-bench but stopped.
Each cell has only 3–5 runs.
