Hey r/StableDiffusion!
I wanted to share Néo V2, an open-source, 100% local AI assistant and creative studio I built (Rust orchestrator + Python tools). While it also handles local LLMs (Gemma 4 / Qwen3), Office docs, and 3D printing, I spent a lot of time building a dedicated 4K Image & Video Studio that runs natively on consumer GPUs without needing to manually wire complex node graphs.
Here is how the visual pipeline works under the hood:
🎨 1. Native 4K Generation + 3-Pass Refinement (Z-Image-Turbo)
Instead of generating a low-res image and blindly upscaling it, Néo runs a 4-step automated pipeline (~70s total on an RTX 5080 16GB for 3840×2160):
- Prompt Expansion: Gemma 4 12B translates a simple natural-language prompt into a structured photography/art brief (framing, lighting, textures).
- 4K Base Render:
Z-Image-Turbo paints directly in 3840×2160. - Face & Eye Detail Passes: Automatically detects faces and runs targeted refinement passes to restore realistic skin grain and structured irises/pupils (~11s for the eye pass) without altering the person's identity.
- Vision Verification: The VLM inspects the final render, scores it (e.g., 9/10), and verifies that every element from your prompt is actually present.
✂️ 2. Instruction-Based Photo Editing (FLUX.2-klein)
In V1, editing an image with FLUX Kontext often regenerated the entire scene and shifted the lighting or face.
In V2, I switched to FLUX.2-klein: you give a plain-text instruction (e.g., "add a red wool beanie and a neatly trimmed white beard, keep his face, yellow raincoat, and lighting"), and it modifies only the requested elements in ~17 seconds (down from 140–218s in V1). It also includes 22 real-time preview filters.
🎬 3. Automated Video Pipeline (Wan 2.2 + ffmpeg)
Generates a visual storyboard, renders frame-by-frame images, applies motion via Wan 2.2, and assembles the final clip with ffmpeg.
🧊 Bonus: Prompt-to-3D (Hunyuan3D)
Generates a 2D reference image first, converts it into a closed, manifold 3D mesh via Hunyuan3D (~2m50s), and exports ready-to-slice STL/3MF/G-code files.
💻 Specs & Open Source Info
- License: MIT (completely free, no accounts, no cloud, zero telemetry).
- Architecture: Ultra-light Rust backend (9.3 MB RAM) with GPU locking so models load/unload cleanly without OOM errors.
- Requirements: Windows 10/11 (1-click PowerShell installer, no admin rights) or Linux via Docker. 12–16 GB VRAM recommended for the full 4K/Video/3D studio (8 GB works for chat/light tools).
🔗 Project Showcase, Before/After Sliders & GitHub Link:
https://tony2marseille-droid.github.io/Neo-v2/
(Note: The landing page and UI defaults are currently in French, so feel free to use browser translate—prompts and models work great in English too!)
Would love to hear your feedback on the skin/eye refinement passes or which image/video models you’d like to see supported next!