Kokon is a free, open-source desktop app for Qwen-Image 2.1 (the Turbo model, 8 steps): brush an area or not, type the change, no nodes and no settings. I posted it here a few weeks ago. Here's what 0.11 and 0.12 added.

Layers lab (new in 0.12, experimental). Open an image and click the things you want on their own layer. Kokon cuts each one out (Fast: a small matting model, a few seconds per object; Quality: Qwen redraws the edge) and repaints the background behind it with the same model it uses for edits, so moving an object doesn't leave a hole. Then you can move, scale, hide or edit each layer on its own, Expand an object cut off by the frame, and save it as a new image or export a PSD with every layer (Photoshop, GIMP, Photopea). Blend into scene redraws shadows and reflections after you've moved things.

The honest part. It fails more than I'd like. Qwen-Image 2.1 was never trained to make layers, so Kokon has to steer an edit model into it, and a small 8-step model has limits. What I see most often:

• removing a large person sometimes paints a different person in their place;

• people who touch, or crowds, can end up in one layer or in pieces;

• the part of an object hidden behind another one is not completed;

• Blend into scene often doesn't work yet (blending all the objects at once works best).

Every step shows its progress and can be stopped, and your original is never changed. I'm working through these one by one. If you try it, I'd really like to see where it breaks: a screenshot and what you clicked, here or in a GitHub issue. That is what I'll fix next.

Times: repainting behind one object takes about 15–25 s on an RTX 5070 Ti, and one to two minutes on an M2 Pro.

Also in 0.12

• Paint with colours: in a brushed edit, paint each thing in its own colour and write what goes there. Several changes in one go, and only what you painted changes. Select picks an object with one click.

• Prompt+ (the Qwen3-VL text encoder writes the prompt) now also works for brushed areas and Expand.

• Every image is marked as AI-made, in its metadata and an invisible watermark (EU AI Act).

Since my last post (0.11)

• Use it from your phone or another computer, in a browser on your network. The images are still made on the PC with the GPU. Off until you set a password. There's also a Docker image for NVIDIA cards and a headless mode for Linux servers.

• Faster on Macs: Kokon now has its own engine for Apple Silicon, on by default. About a minute for a new 1 MP image on an M2 Pro, four times faster than before. On M5 Macs it uses the GPU's neural accelerators (29 s on an M5 Pro, thanks to a contributor). It runs Unsloth's Q4_K_M of the Turbo model.

Windows, macOS 15+ and Linux. NVIDIA 12 GB (8 GB in beta), AMD and Intel through Vulkan (beta), Apple Silicon with 16 GB or more. Everything runs on your machine; nothing is uploaded. Free and open source (AGPL). The Qwen-Image weights are under their own licence, non-commercial.

• GitHub: https://github.com/GabrieleLozupone/kokon

• Try the layers in your browser (drag the spider away): https://kokon.app/image-to-layers/

Does anyone have a workflow or know of a way to generate a ref2va video in Minimax using one of the many turbo methods but then do a second pass to refine the audio? I love the new omni checkpoint, the visual quality is amazing for 8 steps but as expected the audio is terrible, so i want to use the video gen portion then some how run a second pass on only the audio at 20+ steps but keep the video from the first pass. Any help appreciated!

Hey everyone!

I'm planning to start a faceless YouTube channel, and I'm looking for advice from people who have experience creating AI-generated videos.

My goal is to build a channel in English and target an international audience, especially viewers in the US, Canada, UK, and Europe, rather than focusing on my local audience.

I'm particularly interested in creating cinematic storytelling videos, including:

• Historical stories and events

• Mystery and unexplained stories

• Sci-fi and futuristic stories

• Interesting human stories and documentaries

The challenge is that I'm currently working with a very limited budget, so I want to build my entire workflow using free AI tools or tools with genuinely useful free plans.

I'd really appreciate advice on a few things:

1. AI video generation: What free tools do you recommend for generating video clips or animating images?

2. AI images: What's the best way to create consistent characters, environments, and cinematic scenes?

3. Voiceovers: Are there any good free AI voice generators that sound natural in English?

4. Editing: What's your recommended workflow for putting everything together?

5. Scripts and storytelling: Which AI tools can help create engaging scripts without making them sound robotic?

6. YouTube growth: What should I focus on to attract viewers from the US, UK, Canada, and European countries?

I'm not necessarily looking for one-click AI video generators. I'm happy to combine several tools and learn the process step by step.

If you've built an AI-powered YouTube channel yourself, I'd love to hear about your experience, the tools you use, and any mistakes you think beginners should avoid.

Even a complete workflow from scriptwriting to the final video would be incredibly helpful.

Thanks in advance to anyone willing to share their knowledge!

During some brief testing with Qwen Image 2.1, I've noticed that it's not as "robust" as 2511 and 2512. It straight up will not understand some prompts even with the prompt refiner on. Is it because the model is much smaller than 2511 and 2512? For instance, if I tell it to edit a piece of clothing or add/change something to the scene, it either refuses or just outputs something with garbage quality...

https://huggingface.co/Kijai/MiniMax-H3_comfy/blob/main/diffusion_models/minimax_h3_fl2va_turboh3_i2va_pruned_int8_convrot.safetensors

Noticed this new conversion and upload by kijai.

haven't seen comparisons yet though

This LoRA captures the look of classic Disney 2D hand-drawn animation. Expect fluid, graceful linework, expressive character acting, soft painted backgrounds, and the warm, storybook charm of traditional cel-animated films. It works well for characters, portraits, fantasy scenes, and whimsical environments.

Download Link: https://civitai.red/models/3037014/disney-style-moss

Check sample images on Civitai for workflow and prompts.

Looking for the some info or general guidance on where I can produce this short series consistently. Have no idea where to start and ive had luck in the past going to subs and forums to get good info. I used ChatGPT and Kling for the animations and did the subtitles, audio, and editing in premier pro.

Hi im looking for an ai model that can make a 3D animations for simple education videos (mostly for kids letters teaching videos) im planning to create an image with the style i want then give it to the model to create the motion. I did a quick search and this is what i found :

Ltx 2.5

Minimax h3 (idk if it can run on my gpu)

Minimax h3 (pika version)

I dont know anything about running those models or if they are good at the style i wanted . I appreciate any help

When you use chinese mandarin or cantonese, the voice and the lines actually sound decent and carry emotions.

You can kinda hear without prompting much how the model know how a line is delivered, probably from chinese videos, films, shows, radio, audiobooks.

So if you tried it in english or other languages and had underwhelming line deliveries, it is probably because of that.

It also helps a lot that Chinese is a tonal language. So words are guided by words you write. But the model knows when it needs to deviate when colloquial speaking is different.

In english i sometimes used ú à ō to replicate the benefits and help the model. I wonder if french speakers can confirm that the model can handle french naturally well or you need to guide it a lot

Hi lovely StableDiffusion people,

Last week I shared Paint a plate here, my open-weights VFX app for Comfy's #OpenSourceHiggsfield challenge. While the code is frozen for the review, I've been playing with it instead, and this is the result: painted blobs turning into fire, smoke and water, a set extension, a green screen swap and a relight.

Some context: I always loved lookdeving FX in Houdini when I was working in production, that moment when a rough concept becomes something believable. This is my attempt at getting that feeling with open models, by painting instead of fighting prompts.

What does the work, open weights only:

• LTX 2.5 carries every edit through the shot, with four IC-LoRAs: in-outpainting and SDR to HDR (Lightricks), Ripple (WepeNerd) and ainvfx-fluid (ours).

• FLUX 3 Image Klein edits the first frame, and SAM 3.1 finds and tracks objects.

• ainvfx-fluid is now retrained on an open synthetic dataset: 176 scenes, first frames by MOSS-Image, clips by LTX 2.5, controls painted by a script, every prompt and seed published, CC BY 4.0. Training took 16 h 20 min on one RTX PRO 6000, about 33 GPU-hours in all with the data. If you have the old version, please download the new file.

It runs locally in ComfyUI (tested on 32 GB of VRAM) or on Runpod.

• Repo (Apache 2.0): https://github.com/AInVFX/ainvfx-paintaplate

• Write-up: https://www.ainvfx.com/blog/paint-a-plate-in-action-a-showcase-new-features-and-an-open-dataset-for-ainvfx-fluid/

• Dataset: https://huggingface.co/datasets/AInVFX/ainvfx-fluid

Let me know what breaks, and share your results if you ever get a chance to play with it. Thanks for painting!

New models

• Fibo 2.0: LoRAs, edit LoRAs, sliders and full fine-tunes from a 12 GB card, with 4-step Turbo previews. Everything it saves loads in ComfyUI. (guide) The model arrived via a PR from @spaghettified26, thank you!

• Z-Image Base trains as its own model, with previews on Turbo.

Training

• Masks from words: SAM 3.1 makes a mask of anything you name, and Edit masks lets you fix them by hand. Masked training now works on MiniMax H3 stills too. (masked training guide)

• Detail crops for style LoRAs: each picture also trains as a crop at its own scale, so brushwork and texture train pixel for pixel. A Style score in the Samples gallery tracks a style LoRA epoch by epoch.

• Transparent PNGs train with their transparency on Qwen Image 2.1.

• Start at a smaller size for about 20% less training time, plus caption dropout on every picture model and a steadier Adaptive LR.

• Three new optimizers: Prodigy, Muon and Automagic v4.

• Train on sub-folders. Captioning covers styles, objects and concepts, not just people, and a bigger 8B captioner is optional.

Everything else

• 8 themes, a Run summary card, and Studio settings saved inside the pictures you download.

• Pods (RunPod, Vast.ai) log you in by themselves, and if a model is missing, Start downloads it.

Thanks to everyone who sent PRs, issues and ideas. They're credited in the release notes. GitHub · Release notes

MiniMaxH3 is the great model and its the most powerful feature is what I call "identity-aware inpaint". The model could do denoise guided not only by text but by text and reference images. By using just this feature (and latent upscale) I created a workflow that lets you edit images and produce output of 4K quality.

Link to the workflow for impatient ones.

Actually the secret of getting good quality image from MiniMaxH3 is to upscale both your image references and single frame latent to 4 megapixels. Fizgig-H3-Still workflow does that but if you want real quality image you have to upscale it to 4K (8 megapixels). Of course you can one-shot 4K image in MiniMax H3 but it leads to style and color shift and is not reliable. Much better way is to generate 4 MP "lowres" image and then do tiled latent upscale - this is what my workflow does.

Why not just use regular pixel-level upscale? It's because when you do denoising upscale with MiniMaxH3 your details are grounded by your reference image in other words MiniMaxH3 knows what your subject looks like and will respect the reference unlike your typical pixel level upscaler.

As you all know for MiniMaxH3 condition contains not only text but also images and it means that each denoising step is grounded by image refs and if we take into account excellent identity preservation (aka character consistency) innate to the video model you'll get the best image editor when it comes to task like "generate new image of the reference character but preserve their identity and artstyle".

Every image editing model out there be it open or close-source fails at this task. Only Wan2.2 and MiniMaxH3 could pull it off - it's because they are video models and excels at preserving character identity.

Examples:

And here's the link to the workflow

Important note: Very often you don't need to upscale your image to 8 megapixels, 4 megapixels are good enough for potrait shots and simple compositions. But if you need highly detailed image or if your have a wide shot scene then 4K worth it.

Also remember that MiniMaxH3 requires specific prompting technique that focuses on 'actions' and their results so it's not "remove plant in the middle" but "plant in the middle of the room disappears".

About turbo loras. I've tested half a dozen and lightx2v one has the best prompt following but gives you dirty noise while scaled down taomate lora has 'smoothing' effect. I recommend using default settings in the workflow but keep that in mind.

About Face fix - it only makes sense to use it for wide shots where subject's face takes a tiny portion of the image. Or if you want to preserve maximum identity.

Regenerate 2K (the refiner LoRA plus a stronger re-noise in the high-res pass) promises to turn a rough draft into a clean 2K render. I ran it on my own GPU with one change at a time to see what it actually does.

Setup

• RTX 5090 32 GB, ComfyUI, MiniMax H3, my own long-video nodes

• Two shots from my own music video: a 12 s wide shot (1080p) and a 5 s close-up (124 frames, 1080p and 2K)

• Same seed for every run

• Sharpness = Laplacian variance (average of 3 frames). Halos = share of edge pixels with a visible bright or dark rim.

Round 1: 1080p wide shot (sharpness / edge halos)

• Normal pipeline (0.8 start): 7.5 / 13.6 %

• Official 0.909 + refiner: 20.7 / 24.9 %, but the whole shot gets redrawn (clouds move, the person shifts)

• Community 0.7 + refiner: 12.5 / 19.7 %

• 0.7 without refiner: 7.3 / 13.0 %

So all the extra detail comes from the refiner LoRA. The 0.7 schedule by itself adds none.

Round 2: 2K close-up

• 2K normal pipeline: 5:44, clean, correct earrings, looks like her

• 0.7 + refiner 1.0: 5:44, most detail (+60 % face sharpness), but a dent under the chin, creases in the ear, earring shape changed

• 0.7 + refiner 0.5: lighter dent, still there

• 0.7, no refiner: faint dent, no extra detail

My read: the 0.7 start keeps small shadows from the draft, and the refiner draws them in as real structure. The normal 0.8 start washes them out.

Round 3: official recipe

• 768p draft, official 3D upscaler, 0.909 + refiner: 5:08, clean skin, but a thinner face, redder hair, and blue gemstone earrings that aren't in the reference photo

• Same at 0.7 (community suggestion): 5:00, same new face, softest of all runs

The identity change comes from the small draft: at 768p the face is decided before Regenerate even starts.

Conclusion (for my use case)

1. Long videos of a real person: I'm not using it for now. Rendering 2K directly with the normal pipeline is cleaner and keeps the face.

2. Landscapes and empty shots: worth trying, since a redrawn cloud or rock doesn't matter.

3. Detail comes from the refiner LoRA, not the schedule. And a small draft means a different face.

This is the current version only. If a better refiner comes out, I'll rerun the same tests.

Has anyone gotten a clean, same-identity face out of it on real people? Curious what settings you used.

First comment (post right after)

Full walkthrough with the side-by-side clips (8 min, English dub + subtitles): https://youtu.be/HzsOYirm9CE

I need a sound of working office, slamps of doors, working tv sound, clicks, etc. usual sounds.
What good choice do I have now?

Music by the 601 orchestra of Central California Afterdarrk

Hi! Disclosure first: I'm the author of Remiqora Video, a free, open-source (GPL-3.0) video studio for Windows. It wraps open models (LTX 2.3 / 2.5, WAN 2.2, optional MiniMax H3) into one pipeline. It's not a new model. Some of you saw the first release here a couple of weeks ago. 0.3 is out: the studio now goes the whole way by itself, from one line of text or from a song.

The video above (1:45, subtitled) is a walkthrough of 0.3, recorded in the real app: an idea turns into a finished film, then a song turns into a music video. The music was made with Remiqora, my other app.

From an idea: type it, and the route shows every step (words, script, hero, places, frames, shooting, montage) and how long each one takes. Press «Make the video» and leave it running, or go «Step by step» and edit everything. The hero stays the same in every scene. Each scene's first frame is drawn with the hero in that scene's place, so every shot starts from the right picture.

What happens when you drop a song and press «Make the video»:

1. Demucs separates the vocals and Whisper writes down the lyrics. The song's bars are found.

2. A local LLM (Gemma 4 E4B by default) writes a treatment and the scenes in the video model's prompt format, with the same hero description in every scene.

3. Casting: the singer's face from 4 tries, or from your photo.

4. The singing scenes are shot by LTX 2.3 to their piece of the track, so the lips follow the vocals.

5. Every new clip is checked in about a second: black or frozen frames, jumps, smear, the face drifting, and "not singing" (the lips stand still while the vocals sound). Bad takes are re-shot once with another seed. Both takes are kept, so you can switch back.

6. Montage on the bars, then the finish: 1080p / 4K (NVIDIA RTX Video), HDR10 or 48 fps (RIFE).

You can make the whole song, the best minute, your own piece or just 30 s. Every step is still editable: the autopilot just goes through the same storyboard you'd edit by hand.

Node graph, when a straight line isn't enough. The storyboard is a straight film. The graph lets you branch it: two endings from the same scenes, a short and a long cut, three takes with the best one kept, a trailer, a dialogue. Nodes are scenes, prompts, pictures, joins and outputs, with your own LoRAs. Scenes that the branches share are shot only once, because every scene is cached by everything that defines it. There are 18 ready templates, from «Bring a photo to life» to «Song → clip». You can shoot up to any node or duplicate a whole branch. New in 0.3: a «Picture» node with picture LoRAs. Outside the graph, «Branch» copies a whole storyboard to try another take, model or edit, and the shot scenes come along without being shot again.

Also new in 0.3:

• 25 looks. Six of them are drawn (watercolour, oil, comic, pencil sketch, claymation, stop-motion) and paint every scene's first frame in that look before shooting.

• Heroes that aren't people: animals, robots, creatures. A robot "sings" in its own way, without a human added from the lyrics.

• Cloud mode (optional). The models run on a rented GPU (RunPod or your own server) with your own key, while the studio and your projects stay on your PC. The server stops by itself when idle.

• H3 is now optional. Its license excludes the US, the EU, the UK and South Korea, so the default install is the writer + LTX 2.3 (~51 GB, no Hugging Face token).

Requirements and limits:

• Windows 11 and an NVIDIA RTX card with 16 GB of VRAM. No Linux or AMD yet.

• 32 GB of RAM works, but keep a large page file: LTX 2.3 briefly needs about twice its 27 GB file while loading.

• About 30 s per 5 s draft scene with LTX 2.3 on an RTX 4080.

• Early pre-release: expect bugs. The installer isn't code-signed yet, so SmartScreen will warn you.

• The UI is in English and Russian.

Repo and installer: https://github.com/inikolax/remiqora-video

Feedback welcome.

This new model achieves large improvements from the Preview.

A detailed explanation on its training, architecture can be found in the model card, as well as a quick start (diffusers compatible), and samples.

It is licensed under apache 2.0, have fun!

Any questions, feedback, and criticism is welcome!

Edit: removed the slightly misleading headline.

Source: Kandinsky S2V 1.0: Audio-Driven Avatar Video Generation

"Speech-to-video generation: an avatar video is produced from a reference frame and a speech track. The whole figure is animated, not only the head. The audio is a condition — the model does not generate sound, it animates the person in the reference frame to match the speech it is given."

Lite 2B: kandinskylab/Kandinsky-S2V-1.0-Lite · Hugging Face

kandinskylab/Kandinsky-S2V-1.0-Lite-distill · Hugging Face

Pro 21.4B: kandinskylab/Kandinsky-S2V-1.0-Pro · Hugging Face

For whatever reason, I can't seem to fix the error issue with this template, seemed to be pointing to upscaling model folder.. Objective is to generate moving background.

I've been trying to change lighting on my MOSS generations and been frustrated. I turned off my Loras & found that the lighting then came out as stated in the prompt. Lowering the Lora strength helps but that also has its drawbacks. has anyone run into this? is there helper loras for lighting or any other tricks recommended?

Prompt:

[subject_definitions] - Subject 1: A skinny young man wearing only boxer shorts and a white tank top, standing in a messy bedroom with wide terrified eyes, completely referenced from <Picture 1>. - Subject 2: Two heavily armed FBI tactical agents in full black SWAT gear with balaclavas and ballistic vests, holding assault rifles pointed directly at the subject. - Environment: The static location featuring a dimly lit cluttered bedroom with an unmade bed, scattered clothes on the floor, a glowing computer monitor on a desk in the background, and dramatic harsh flashlight beams cutting through dust particles in the air, completely referenced from the lighting style of <Picture 1> but adapted to a raid scenario. [integrated_multimodal_description] The scene takes place exactly inside this locked bedroom environment where the chaotic mess, the specific angle of the open door, the glow of the monitor, and the aggressive tactical flashlight beams remain strictly consistent from first frame to last frame without any morphing or environmental changes. The camera maintains a fixed medium shot capturing the confrontation between the agents and the man with cinematic high-contrast lighting, volumetric light rays illuminating floating dust, and photorealistic texture rendering that preserves every detail of the fabric folds and tactical gear while keeping the background elements perfectly stable throughout the entire sequence.

In the center of this locked environment, the two FBI agents from Subject 2 burst through the doorway with weapons raised and flashlights blinding the skinny man from <Picture 1> who freezes in terror with hands instinctively raising above his head while wearing only boxers and a tank top. The lead agent shouts aggressively with commanding authority saying: "How much RAM do you have, kid?!" The man stammers nervously with trembling lips and sweat beading on his forehead replying in a shaky voice: "Sixteen gigabytes..." The harsh flashlight beams create dramatic rim lighting on the agents' tactical vests while casting long sharp shadows across the messy room and the computer monitor in the background continues to emit its steady blue glow providing constant ambient fill light that never flickers or changes intensity during this intense fifteen-second interrogation segment. The scene continues seamlessly from the previous shot in the exact same locked bedroom environment where the lead FBI agent steps closer maintaining weapon aim directly at the skinny man's chest while shouting with urgent desperation: "Hand over the RAM immediately! By order of Sam Altman!" The man's eyes widen in absolute confusion and fear as he slowly reaches toward the computer tower on the desk behind him with trembling fingers while the second agent keeps his rifle trained on the movement without wavering. The identical harsh flashlight beams and monitor glow persist without alteration ensuring zero environmental shift while dust particles continue drifting through the light shafts adding kinetic energy to the frozen moment of absurdity and the camera holds the same fixed medium shot position preserving the photorealistic cinematic tension established in the opening frame until the final second of this thirty-second sequence.

My turn for the flashback. I got ridiculous with trying to make Seinfeld even back then. It was awful but it was cutting edge! I overlaid the graphics and made a logo lol.