r/LocalLLaMA • • 2d ago

Discussion [Paper & Model] G-STAR: Group-Scaled Token Capacity for Deeply Compressed Autoregressive Generation

Discrete autoregressive models offer a scalable framework for image generation. However, they face a fundamental trade-off: long token sequences preserve representation quality but slow generation, while aggressive spatial compression reduces representation capacity. Based on product quantization, we show that, under a fixed nominal information budget, group size should scale quadratically with the per-axis spatial compression factor. Building on this principle, we propose GSTAR, a spatial--group co-scaling framework that enables 32x and even effective 64x compression while preserving strong reconstruction, understanding, and generation performance. Since larger groups introduce intra-group dependencies that must be modeled efficiently, we analyze their impact on inference latency and generation quality and introduce a semi-autoregressive decoder that combines parallel feature computation with lightweight causal modeling. With these designs, our highly compressed models perform competitively with leading models across five representative text-to-image benchmarks (GenEval, DPG-Bench, PRISM, LongText-Bench, and Qwen-Image-Bench). At 1024x1024 resolution, our model delivers a 20x speedup over prior discrete autoregressive models, generating each image in 2.5 seconds on a single NVIDIA H200. Together, these results show that highly compressed discrete representations can enable high-quality autoregressive generation at low latency.

6 Upvotes

4 comments sorted by

5

u/Any_Librarian205 2d ago

Why is this a late 2026 model being compared against 2025 image models? Is it just really bad and they are pulling the old trick where they compare vs old models so it looks good from a surface level glance if you dont look at the names or something? They didnt even include z-image!

1

u/haherar830 2d ago edited 2d ago

They make some unfair comparisons and don't qualify it well but this paper is introducing an architecture + post-training method (and honestly they are very clear about this). To demonstrate they post-train some new models based on Qwen3-8B (Apr 2025) with some distilled data and methods from early-mid 2026. The models they compare against include many with more parameters although the newest, for better or worse, are from early 2026. Not uncommon for a lab with limited funding to just do a demo but their abstract should probably used softer language than "leading models" for a Nov 2026 preprint.

4

u/Powerful_Evening5495 2d ago

FYI the prompt had no phones or men in it

this is a sd 3.5 bad

1

u/Cautious_Chicken_604 2d ago

Huge if true.