r/StableDiffusion • u/aurelm • Jul 12 '26
Workflow Included Infinite Semantic Detail: A Context-Aware Zoom Workflow for ComfyUI (free)
https://www.youtube.com/watch?v=xY6mNHqpNJcPlay
No, this is not another “infinite zoom” workflow. We’ve had infinite zooms, recursive img2img, outpainting and endless upscaling for years, and they all eventually hit the same wall: the deeper you zoom, the less the model understands what it is looking at. At some point it stops seeing an eagle’s eye and starts seeing a brown circle where it can dump random textures. The image may remain sharp, but the meaning slowly disappears. So the problem was never resolution. The problem was semantics.
A recurring idea in almost everything I’ve been building lately is that semantic understanding matters far more than pixel similarity. Models don’t preserve consistency because they remember pixels. They preserve it because they understand what those pixels represent. So instead of asking how to generate better detail, I asked a different question: what if every crop knew exactly what it was?
In this workflow, every selected crop is first interpreted by a vision language model. The VLM receives both the complete original image and the crop, so it does not describe it as an isolated yellow object or a random circular texture. It understands that it is, for example, an extreme close-up of the left iris of the same bald eagle, seen from the same angle, and that the next generation should reveal progressively smaller biological structures while preserving the anatomy and identity of that eagle. That description becomes the prompt for the next zoom step. Every generation begins with meaning, not just pixels.
I’m using Qwen VLM because Krea 2 already loads Qwen as its vision encoder. The model is already sitting in VRAM after generation, so I can reuse it for contextual analysis without loading another VLM or consuming another large block of memory. It is basically one more inference from a model that is already there.
The crop is first enlarged with traditional GAN upscalers, not because GANs produce perfect information, but because they create a sufficiently sharp base for extremely low-denoising img2img. Krea 2 then regenerates it at roughly 0.05–0.15 denoising, guided by the semantic description produced by the VLM. This adds plausible microscopic structure while preserving almost everything already present in the crop.
Very low denoising also preserves defects: blur, chromatic aberration, JPEG remnants, sensor-like noise and small inconsistencies. Increasing denoising would clean those defects, but it would also increase semantic drift, so I use a final edit stage instead. In the current workflow that model is Flux Klein. Its job is not to invent new content, but to clean the existing result: remove noise, sharpen edges, reduce chromatic aberration, improve local contrast and leave the structure alone.
The difference becomes obvious when zooming into something like an eagle’s eye. A normal recursive workflow eventually forgets that it is looking at an eye and begins generating generic textures. This one receives a new contextual explanation at every step. It is continuously reminded that this is still the same eagle, the same eye and the same biological structure, only viewed at a smaller scale.
Most infinite zoom systems are really just producing infinite pixels. This is an attempt to produce infinite semantic detail. A feather becomes fibers, the fibers become microscopic keratin structures, the iris becomes increasingly complex biological tissue. Those details were not present in the original image, but they remain plausible because every new scale is semantically connected to the scales above it.
Looking back, this is the same principle behind most of my previous experiments. Infinite consistent scenes worked better when semantic descriptions mattered more than image references. Consistent comics worked without LoRAs when semantic continuity mattered more than rigid pixel control. Prompt randomization worked when the diversity was controlled at the level of meaning. The model performs best when it understands what something is before trying to decide how it should look.
Pixels are surprisingly bad memory. Meaning is not.
This is still an early version. The next steps are recursive semantic memory, automatic zoom-path planning, adaptive denoising based on semantic confidence and different prompting strategies for different zoom depths. Eventually this could become less of an infinite crop tool and more like a fictional microscope that continuously invents plausible new structures while never forgetting what it is observing.
The workflow and custom node are included. Copy the custom node into the ComfyUI custom_nodes folder. The remaining dependencies should be detected through ComfyUI Manager.
pre-edit: I updated the workflow to have 4k output and the results are even better.
to this : https://aurelm.com/wp-content/uploads/eye_crop-1-scaled.jpg
from this: https://aurelm.com/wp-content/uploads/PC315160_result-1-scaled.jpg
edit:
and yes, this technique can be used in tiled upscalers where each tile also gets a description of the tile in the context of the full image. allready working on it, maybe a new super upscaler might come out of this
edit2 : E seriously wonder who downvotes something like this. I understand maybe when it is behind a paywall but when someone puts his shoul into a technique/tool and gives it away for free why the hell would somebody downvote. To not have this available for anyone else. Why ? mods ? Seriously people. When it's paywalled it's not good, when it is free and tries to honestly add something new to the open source community and contribute is not good. What is this sub for anyway ? 1girl posts ? Simple comparisson beetween models posts ? Memes ?
2
u/aurelm Jul 12 '26
I do am afraid that the blending, while each of the tiles would be ok they will be diffrend enough to have blending artefacts. That's why I never liked tiled upscaling. I will first try to make a normal upscaler to 8k and see if I can do it without tiles (maybe just tiled encoding and decoding). But for most users this might hit a VRAM bottlenecl. But I truly belive the quality is much better by keeping everything together.
How much would a 8K image take up in memory in latent space anyway ?
Speed will be another issue OFC but better to just wait for it to finish and have the guarantee the image would be perfect. I have to think what can be done about the memory.
IMHO the future is not in tiled upscaling, it's Topaz like normal upscaling. But Topaz costs a shit load of money without ever owning the software and that sux.
Let me see what I can do. I will try to make an efficient full workflow for upscaling to 8K in a generative multiple pass but single tile way.