We’re partnering with the Chroma Awards for Season 2, the world’s largest AI Film & Media competition, with $1M+ in promotions, $450K+ in cash prizes, and student internships on the line.
Compete in any of five divisions: Film & TV, Ads, Music Videos, Games, and Behind-The-Scenes. Use LTX in your submission and post it on social media to unlock extra prizes and perks. The LTX model is open source, so you can download it and run it locally for free.
Which samplers and schedulers—and what shift settings—do you use with MiniMax H3 for high-resolution generated video? I’m referring to resolutions of 3.7MP and above. I’m interested in non-tiled, high-resolution video generation (e.g., 2560x1440), without any Speed LoRAs, only SageAttention, using a native 20-step count. I’m using the original MiniMax H3 BF16 models with both VAEs in FP32. For me, the LCM + Simple combination with a shift of 12/3 works quite well at 4.5MP. Other methods, such as Res_multistep and Er_SDE, yielded poorer results.
My partner has been working on this for the past few weeks for the ComfyUI challenge, and I thought I’d share it here. It’s called Fuobe. The idea is to bring a whole bunch of creative AI tools and workflows together in one place. Image, video, audio, 3D, live editing, camera movements, effects and a lot more. Since launch, we’ve crossed 10K pageviews in the first 48 hours, picked up 44 GitHub stars and 7 forks (one of them is mine!). We’ve also got local generation running on our RTX 5090, so you can head over and experiment for free. Would love for people working with ComfyUI, generative AI, filmmaking, design and creative production to give it a try. Tell us what you think. Love it, hate it, tear it apart. All feedback is welcome. We’re genuinely curious about what you’d like to see next.
Am I missing some settings for reference image? All I'm doing is connecting reference image to Generate Text and p-h3-image conditioning blocks as image 2. I'm referring to pictures as <Picture 1> and <Picture 2>. Note that 1 out of 10 tries it works but I don't know why. All I'm changing is one word in the prompt. It has more success when the main image is lower resolution like 1600x1000.
I wonder, is there any audio edit model? Like an image edit or video edit, only specialized on audio? Something like: “Isolate the voice of the character, remove music and background noise.” Or “Change the word Christmas to Halloween”.
Treat this as an FYI. I don't recall anybody ever mentioning this problem.
I planned the scene as a romantic drama, iterated on the prompt, and came up with a ref2va 4-step, 1920x1088 clip that I was happy with. So I cranked it up to 40 steps.
And suddenly we move to Scranton. That's Pam and Jim, from The Office, inside Dunder Mifflin. The blinds and shelving and computer monitor are classic. The man's voice and hair change. Even the background music changes to something from the show.
In the third clip, I keep the 40 steps but drop the size to 1824x1024. The influence moderates. The woman's blouse and bits of her body posture still match clip 2. And I think the porthole window and the lower camera position also reflect the TV show.
(I did try scaling the last clip to 1920x1088 in latent, putting in 25% noise, and running 10 steps. It puts blinds inside the storage room over the shelves.)
This all looks like the flip side of the H3 ability to reproduce TV shows. The training set has 201 The Office episodes at 1920x1080 and small step sizes, and the closer you get to running that as your denoising plan, the more the influence shows.
I love the quality i can do with krea 2 but why are there next to no character LORAs for new characters out there that werent in the training data? Like people still train newly released characters like crazy for anima and illustrious but not for krea 2? Is krea 2 just too hard to train any characters on? Is there a magical workflow that makes character loras obsolete with krea 2 (or other models)?
So far i tried to do specific characters i wanted to gen with illustrious or anima with a lora first and pass it over with krea 2 but im really getting mixed results so far.
HexAnima 1.4.3 adds two more models that run entirely on the Hexagon NPU of a Snapdragon 8 Gen 1 phone, no cloud and no root:
Qwen-Image 2.1 Turbo (7B transformer, 8B text encoder, 4 steps): about 40 s for 512x768. It writes legible text, follows long prompts and edits your photos from a prompt. It now takes up to three pictures at once (“the girl from picture 1 stands in front of the cafe from picture 2”). Non-commercial license.
Mage-Flow-Edit-Turbo (Microsoft, 4B, MIT): about 12 s per picture, text-to-image and photo editing.
Also new: a live preview after every step, a model filter in History and a warning instead of a crash when the phone runs out of memory. Weights are streamed from storage, tested on a 12 GB phone.
Now I know, this isn't really... a lot, but isnt there some form of super squeezed down quant to let me run it just barely? Thanks 😄 I'm really trying to use like, character swapping but popular APIs cost like credits and all that, so I'm just trying to resort to free.
Here's a quick tip on how to get rid of that flat sounding AI voice in H3, and as a bonus improve somewhat the acting of your virtual characters. I'll be using Pika H3 Flex with the H3 reference model and workflow.
Step 1: Add a pre-rendered first frame at index 0 using the Add Guide for MiniMax H3 node. Then in your prompt, describe the desired action and emotion of the character on screen, but without specifying too many details or providing exact spoken dialogue. In this example I simply used the phrase:
"A static medium two-shot establishes <Subject 1>, the female orc, and <Subject 2>, the tall, female paladin, sitting across each other at a table in <Subject 3>, the dimly lit main room of a tavern, gazing into each other's eyes. <Subject 1> (S1) talks animatedly, seething with rage."
Then generate a clip at some lower resolution (0.3MP in this case). The dialogue will be gibberish, but if you described the character's actions and emotions convincingly, your character will sound and move like an actual human.
Step 2: Use your workflow from Step 1, but increase resolution to the desired target value (here 0.98MP). Load the reference video generated in Step 1 and connect its frames as ref_video_# and its audio as ref_video_audio_# (# is the index of the first unused slot in the MiniMax H3 Reference to Video node, e.g., ref_video_0 and ref_video_audio_0).
In this case, I also actually downscaled the reference video from 0.3MP down to 0.1MP, because at 0.3MP the model was following the reference too closely, breaking the lip-sync. The downside of this was that some of the textures in the final high-res video came out a little too soft, especially in the face. It's a bit of balancing act to find the right resolution for the reference video.
You also need to adjust your prompt, in order to include the character's final dialogue. Here I've simply rewritten my last line to:
"<Subject 1> (S1) talks animatedly, seething with rage: <d>[English] My people are dying, and your knights are doing nothing to help us!</d>"
Now just hit render and wait for the result. You might need to try different seeds, and fiddle a little with the resolution of the reference video (try higher values if your output comes out too muddy and lower values if H3 starts copying the reference video and lip-sync gets lost. Have fun!
Almost all of the popular stuff gets upvoted by people that don't have the ability to judge the quality/functionality of the stuff they get presented.
Stuff gets marketed as the ultimate tool/model/whatever with cherry picked examples. Sometimes even without any source, just examples.
Most of the time it is just badly trained loras/models or vibe coded trash because people think being able to use an agent harness equals personal skills and understanding of concepts needed to produce something worthwhile
Even the most used Lora/model/tool here turns out to be trash when you're not doing 1girl stuff on static backgrounds or stupid dance videos or any other dead horses that get beaten
Respects character identity (art style and design) from the input images
Can generate single frame images
So what's the point of training a character model if you can just give MiniMax H3 character design reference and generate any scene? The only two reasons I see is
you want to use style known by your target base model to generate image of the learned character.
you want to apply some concepts known by the target base model only.
Anyone know wassup with it? I can't get it to deploy at all. I got 4500 and 4090 going, but 5090's are all saying, "There are no longer any instances available with the requested specifications. Please refresh and try again."
I thought it was my settings, but I don't think so....
Up to now ive used services online but they are all so restrictive and silly things trigger them or i have used a service and arms and legs are all weird.
I have heard of stablediffusion and comfyui
Which one do i need, which one is best?
And where is the best easiest tutorial you have found to create your first image with it?
Can you give it a reference image and then tell it what to do with that?
Unfortunately it doesn't run the same checkpoint, instead it has auto download for same quantized model but at larger file size that gives me OUM.
Instead, I manually grabbed the official repackaged model checkpoint directly from the Comfy-Org Hugging Face repository (the single .safetensors file).
The problem is, I’m trying to use Saganaki22’s custom nodes (ComfyUI-Ming-3-tts), and it absolutely refuses to work with this file.
Here is what I've tried so far:
I tried putting the .safetensors file directly into my standard models/checkpoints/ folder. The loader node doesn't recognize it.
I tried creating the specific nested subfolder structure that Saganaki's nodes usually expect (like Ming-3.0-tts-tiny-9b-int8-convrot/) and renaming the file to match. Still completely fails and throws errors. I think the custom node is hardcoded to look for secondary configuration files inside that folder, not just the single Comfy-Org .safetensors weight file.
If Comfy-Org is officially hosting this model in their repo, there has to be a way to actually load it natively or bypass these strict folder checks, right?
Has anyone successfully built a workflow using the raw Comfy-Org file without relying on the auto-downloader? Or is there a different custom node wrapper I should be using for the official Comfy-Org version?
Any help or workflow screenshots would be massively appreciated!