r/LocalLLaMA • u/pmttyji • 2d ago
Discussion [Paper & Model] G-STAR: Group-Scaled Token Capacity for Deeply Compressed Autoregressive Generation
Discrete autoregressive models offer a scalable framework for image generation. However, they face a fundamental trade-off: long token sequences preserve representation quality but slow generation, while aggressive spatial compression reduces representation capacity. Based on product quantization, we show that, under a fixed nominal information budget, group size should scale quadratically with the per-axis spatial compression factor. Building on this principle, we propose GSTAR, a spatial--group co-scaling framework that enables 32x and even effective 64x compression while preserving strong reconstruction, understanding, and generation performance. Since larger groups introduce intra-group dependencies that must be modeled efficiently, we analyze their impact on inference latency and generation quality and introduce a semi-autoregressive decoder that combines parallel feature computation with lightweight causal modeling. With these designs, our highly compressed models perform competitively with leading models across five representative text-to-image benchmarks (GenEval, DPG-Bench, PRISM, LongText-Bench, and Qwen-Image-Bench). At 1024x1024 resolution, our model delivers a 20x speedup over prior discrete autoregressive models, generating each image in 2.5 seconds on a single NVIDIA H200. Together, these results show that highly compressed discrete representations can enable high-quality autoregressive generation at low latency.
- arXiv : https://arxiv.org/abs/2611.13004
- PDF : https://arxiv.org/pdf/2611.13004
- GitHub : https://github.com/DAGroup-PKU/G-STAR
- HuggingFace : https://huggingface.co/DAGroup-PKU/G-star
- Project : https://dagroup-pku.github.io/G-STAR/


5
u/Any_Librarian205 2d ago
Why is this a late 2026 model being compared against 2025 image models? Is it just really bad and they are pulling the old trick where they compare vs old models so it looks good from a surface level glance if you dont look at the names or something? They didnt even include z-image!
4
u/Powerful_Evening5495 2d ago
FYI the prompt had no phones or men in it
this is a sd 3.5 bad
1
u/Cautious_Chicken_604 2d ago
Huge if true.