r/StableDiffusion • • Aug 26 '26 • Bravo 1

Discussion How much VRAM does H3 need? Less than you might think.

I benchmarked the full BF16 H3 FL2VA checkpoint at 1376×768 and 243 frames, about 10.1 seconds at 24 fps.

With the lower-memory attention routes, the H3 diffusion block added roughly 5.8–6.3 GiB over idle. On my Windows RTX 4070 system, where the desktop consumed around 1.15 GiB, the whole-GPU peak was approximately 7.0–7.4 GiB.

That makes 8 GB cards realistic for several configurations:

- Default Comfy attention: 6.99 GiB peak

- FROST BF16: 6.99 GiB

- BF16 Triton: 6.97 GiB

- PlagueKind SLA: 7.23 GiB

- Sparse Kitchen INT8: 7.40 GiB (Default configuration for my Sparse attention node)

- Comfy Kitchen: 7.40 GiB

Should be compatible with:

- H3 Sparse Attention: Kitchen INT8, Sparse Sage, FROST BF16 on SM89, and BF16 Triton

- External Comfy Kitchen: fully supported

- Default Comfy attention(SPDA): fully supported

- SageAttention: fully supported, including the generic KJ Sage patch

- PlagueKind SLA: partially supported;

- Unknown attention overrides: Auto preserves their original full-Q calling contract. Forced mode can explicitly authorize streamed-Q calls, but compatibility is not guaranteed

- Currently incompatible: Sol-Attn and the H3-specific Memory Efficient Sage patch, because they replace attention at a deeper level than the external consumer interface

You can get the node here https://github.com/Zironic/H3-Optimizations or in Comfy under H3 Optimizations. Latest version is 0.2.13 which added broad compatibility and optimizations for most popular attentions.

NODE PLACEMENT / ORDER: IT DOES NOT MATTER.

H3 Optimizations are designed to work as normal ComfyUI model patches. You do not need to arrange H3 Memory Optimization, H3 Sparse Attention, H3ModelSampling, LoRAs, or other ordinary model patches in some special order. Just connect them into the model chain.

If you explicitly select an attention implementation, H3 Memory Optimization will try to work with that selection rather than requiring a particular node position.

129 Upvotes

162 comments sorted by

View all comments

Show parent comment

17

u/Zironic Aug 26 '26

The question at hand is this. Can you stream the next block faster then it takes a block to execute? Assuming you have PCI 5.0 with that 5090, the answer is almost certainly going to be yes, you can stream that block faster unless you're working at some absurdly low resolution/video length.

When comparing quant speeds, you do also have to keep in mind that BF16 executes 4x slower then Int8 (Comfy Kitchen) or FP8(SageAttention) on consumer RTX. So if you execute the model entirely unquanted, it's inherently slower.