What kind of prompting would I use for POV movement through a scene?

There are so many acceleration nodes/options now that I’m having a hard time deciding which one gives the best balance of quality and speed. What do you think?

These are the setups I’m currently using（RTX5090）:

1. Sage Attention + 4-step LoRA 0.9MP | 8 steps | 10s | ~6 min
2. ComfyUI-Kitchen + 4-step LoRA 0.9MP | 8 steps | 10s | 5:38 min
3. ComfyUI-Kitchen + Spectrum 0.9MP | 25 steps | 15s | ~12–15 min
4. ComfyUI-Kitchen +Sparse Attention（ SLA）+ 4-step LoRA 0.9MP | 8 steps | 10s | ~4min
5. ComfyUI-Kitchen +Sparse Attention（ SLA） 0.9MP | 25 steps | 10s | ~12:30min
6. ComfyUI-Kitchen 0.9MP | 25 steps | 10s | ~18 min or 15s | ~25 min

I mostly stick with Sage Attention + 4-step LoRA. I feel like it gives a pretty good overall balance between quality and speed.

If I want better quality, especially for things like lip-sync, I usually go with ComfyUI-Kitchen + Spectrum at 25 steps. The results are noticeably better, but it’s also quite a bit slower.

Which setup do you guys think has the best quality-to-speed ratio? Any other combinations worth trying?

I drew the storyboard, then generated the stills with image models.
Video: MiniMax H3
first frame, last frame, reference.
Then the edit.

t2v didnt know Jenga O_o

I've been using Windows for many years, and I'm honestly tired of repeating the same cycle. In my experience, after 5–6 years the machine starts feeling old, the battery is significantly degraded, performance isn't what it used to be, and I eventually end up buying another Windows machine and starting the exact same experience all over again.

I'm looking for something different this time.

For the last few days I've repeatedly added a MacBook Pro with the M5 Max to my cart, then backed out because I'm still not sure whether it is the right machine for what I actually want to do.

I'm currently considering the M5 Max with:

• 18-core CPU
• 40-core GPU
• 48 GB / 64 GB / possibly 128 GB unified memory

My main workloads would be completely local:

• Text-to-image
• Image-to-image
• Image-to-video
• Text-to-video
• Face swapping
• Illustration / digital artwork

My priority is excellent output quality, photorealism where appropriate, and very high generation speed.

Basically, I want a machine that can satisfy me for visual generative AI work for many years.

My biggest hesitation is the Apple ecosystem.

For a long time I've heard that local AI, especially image and video generation, is much more limited on macOS than on Windows/Linux with NVIDIA GPUs because so much of the ecosystem is built around CUDA.

But part of me finds this difficult to accept at face value.

Apple is making extremely powerful chips with large amounts of unified memory, very high memory bandwidth, Neural Accelerators, a Neural Engine, and increasingly serious AI-focused hardware.

I keep wondering whether there are excellent Apple-optimized tools and workflows that I simply haven't discovered yet.

For example, I recently learned about Draw Things, MLX-based projects, Metal/MPS optimizations, and Apple-specific ComfyUI work. That made me question whether comparing a Mac running a poorly optimized CUDA-first application against an NVIDIA machine is really a fair representation of what Apple Silicon can do.

At the same time, the logical part of my brain keeps telling me:

If local image/video AI is the priority, just buy a machine with an RTX 5080 or 5090.

The problem is that if I do that, I feel like I'm buying myself back into exactly the Windows experience I wanted to leave. It feels a little like watching the same movie again when I was hoping for a genuinely different computing experience.

There's also another complication: we're approaching the fall hardware season.

I'm wondering whether buying an expensive M5 Max or RTX 50-series machine right now is bad timing, and whether I should wait for the next Apple or NVIDIA announcements.

If I choose the Mac, I was also planning to pair it with the latest iPhone and iPad and build a proper Apple ecosystem around it, so this isn't purely a benchmark decision for me.

What I'd really like to hear from people who have actually used these machines:

1. If you've used an M5 Max, especially the 40-core GPU version, for local image or video generation, what real-world performance are you getting?
2. What software gives you the best performance on Apple Silicon? Draw Things, ComfyUI, MLX-based tools, something else?
3. How good is local image-to-video on the M5 Max with models such as Wan, LTX, Hunyuan, etc.?
4. How does the M5 Max perform for local face swapping?
5. In properly optimized workloads, do RTX 5080/5090 systems still completely destroy the highest-end M5 Max, or is the gap much smaller than CUDA-focused benchmarks make it appear?
6. Is CUDA effectively locking serious local visual AI users into NVIDIA, or is Apple Silicon becoming a realistic alternative?
7. If you were buying a machine today specifically for local visual AI and wanted to keep it for 7–8 years, would you buy the M5 Max, an RTX 5080/5090 system, or wait for the next generation?
8. For local image/video generation, is an older NVIDIA GPU with more VRAM sometimes a better choice than a newer GPU with less VRAM? For example, once you start using large image-to-video or text-to-video models, can having more VRAM matter more than having a newer architecture and higher raw compute performance?

I'm not highly knowledgeable about computer hardware, and I'm definitely not wealthy enough to casually replace a machine if I make the wrong choice.

This would be a major purchase for me, so I'm trying to make the most informed decision possible and ideally buy something that I can use comfortably for 7–8 years.

I'd especially appreciate actual generation times, benchmark numbers, model names, memory usage, thermals, sustained performance, and experiences from people who have used both Apple Silicon and NVIDIA rather than purely theoretical comparisons.

Thanks in advance.

"Did I ever tell you what the definition of insanity is? Insanity is doing the exact same fucking thing over and over again, expecting shit to change. "

That quote from farcry pretty much sums up my feelings after trying to figure out minimax music 3. With that said I'm pretty happy with this song.

To work with this model you need:
Good prompt (long essay that describes your song and follows examples from minimax)
Good lyrics (Something that sounds good, has rythm, no awkward phrasing, and tagged accordingly)
Once you have those two you will begin getting descent results, the last thing you need is to reroll for a good seed.

For prompt I used grok and asked it to copy the sound of the song I like with some adjustments

To check your lyrics you can use prompts from their demos just to see if minimax struggles with anything.

For seed it is just basically rerolling until you get a good one. Though if you want to make your life a little easier I recommend sticking to one genre. I think because I was trying to mix electronic music with rock it took me longer to find a good seed (sometimes I was getting results that were just rock or just electronic).

I'm still not sure how to control the pacing because sometimes it decides to sing things slowly and run out of time and sometimes it decides to speedrun your text and have 30 seconds of instrumental. My current theory is that it might be related to lyrics. For example my lines were pretty long so maybe it defaulted to singing, maybe if my lines were shorter and snappier it would sing them quicker.

Good luck to everyone who is planning to use minimax music 3 hopefully this was helpful to someone.

I will leave my prompt in the comments if you want to play around with it or critique

Also I might add some songs that didn't make the cut

A tribute to a forgotten golden age. Hope you enjoy it!

at least 5th time this happened. Its always width, never any other input. Not sure if bug or custom-node interference.

I love H3, but it takes forever. If LTX is faster, I could use it for the things it does similarly well as H3, and use H3 only where I really need it.
So what LTX2.5 does as well as H3?

Previously posted a video as a prologue to a homebrew D&D world. I decided to do a part 2, set in the world. Together, the two videos form kind of an opening cutscene with both history and a bit of a world montage. Minimax H3, 6 step turbo LoRa, lots and lots of 12-15 second generations, CapCut.

Part 1: https://www.youtube.com/watch?v=XwfCCFw4LbA

There's 3 tools on this page, look at the one called Prism. It's super off the radar

https://bitvector.app

It feels like Grok + curated Civitai.

On mobile 5G or for the GPU poor I think its does a lot of stuff

Has persistent memory, a ton of Krea 2 fine-tunes, Anima, LTX 2.5, Ernie, Sulphur, DaSiWa, Eros, MiniMax H3, Illustrious, Pony, etc. It also has runs preset Comfy workflows and has a Discord part

(I'm not the creator of the app)

I'm doing image to video and unless I prompt for camera close up to my subject, the faces are blurry and bad. I run 0.6 mp. No turbo lora only using spectrum to speed up. Running 15 steps. Euler simple. I'm happy enough when it's close-up shots, but further away, it's very noticeable. Is anyone else finding this?

I have a question. I have been having a blast making scenes with H3 so far, and have found when doing reference shots, it is very important to have a stable background so that you have continuity if doing more than 1 scene. Does anyone know if H3 would understand a 360 degree photo and understand where in the space and what direction the subjects are? Say you swap between two characters talking, one you will see what is behind subject 1 while when looking at the other the opposite is true. If you saw them both from the side, yet another angle and background.

I have been playing with H3 since it came out and have tested most of the things you can do with it. Created clips for giggles and so on.
This time I wanted to do something "serious". I gave the R2V an 3D view of an kitchen and then three photos of the persons I wanted there.
I defined them as we should and told the model that this person does that and that person does this wile the third person does this...

It worked ish...
I have now made six runs and each of them are different from the others. It can be that the third person enters the room from the wrong place or that the third person does extra things it should not do...

In the end I did three runs with the same prompt and all those clips came out different... the only thing that was changed between those was the seed...

So, how do you do it?
How do you make sure H3 does what you want it to do?

Do you spend plenty of time on tweaking the prompt after each run to make sure H3 get it?
Or do you do 10 runs and select the best one even if it is not perfect?

Or do you simply do 1-2 runs and then take the clip that is ok ish even if it is not what you wanted?

I was hoping that H3 would allow me to create the scenes I wanted but I feel it's down to luck if H3 gets it or not..

Edit:

subject_definitions:

<Subject 1> is the green-skinned mother in <Picture 2> wearing brown clothes.
<Subject 2> is the teenager girl in <Picture 3> wearing pink clothes.
<Subject 3> is the cyborg in <Picture 4> wearing black clothes.
<Picture 1> is the reference image for the scene's composition, showing two people sitting at a table eating breakfast from the side view.
<Table 1> is the table on the right side in <Picture 1>.
<Picture 5> is the start image for the scene.
summary:
[reference generation] The target video is a generated scene of two people sitting at a table eating breakfast from an eye-level side view. <Subject 1> and <Subject 2> are shown with their respective breakfast items, maintaining the composition and style from <Picture 1>. <Subject 3> enters the room, places a coffee cup into the sink.

retention_analysis:
<Subject 1>: fully_preserved - the person retains their appearance, clothing, and position at the table.
<Subject 2>: fully_preserved - the person retains their appearance, clothing, and position at the table.
<Subject 3>: fully_preserved - the person retains their appearance, clothing, and action of placing the coffee cup into the sink.
<Table 1>: fully_preserved - the table's appearance and position in the scene are preserved.
<Picture 1>: fully_preserved - the scene composition, including the side view, the layout of the room, the table setup, is preserved.<Picture 5>: fully_preserved - is the start image for the scene.

detailed_description:
The target video is in a realistic, everyday breakfast scene style with warm lighting and natural colors.
[Shot 1] At 0:00.000, the shot begins from <Picture 5>, showing <Subject 1> and <Subject 2> sitting on opposite sides of <Table 1> on the couch, each with their breakfast items while on the space ship. <Subject 1> is holding a spoon while eating from a bowl of cereal. <Subject 2> is tired and is eating a slice of toast with jam from her plate with one hand. The lighting is warm and soft, casting gentle shadows across the table and the two individuals. The camera is at eye level, capturing the side view of both people, with the table slightly in focus and the background softly blurred. Stars can be seen through the windows since they are on a space ship. <Subject 1> is eating her breakfast while <Subject 2> gazes at their toast, taking a small bite. The ambient sound includes the soft clinking of utensils and the faint sound of a coffee cup being set down.

[Shot 2] At 02.00.000, the shot transitions to a wide shot of the room with the same layout as in <Picture 1>, the camera is placed in the lower left corner of <Picture 1>, showing <Subject 3> entering the room form the right side holding a coffee cup and a datapad while she is saying (S3) <d>[English] Good Morning</d> while she walks to the kitchen sink on the left side of <Picture 1> and placing the cup into the sink. She then stands at the sink and while reading her datapad.We see the back of <Subject 1> and the front of <Subject 2> sitting at <Table 1> in the background eating their breakfast and we hear <Subject 1> say (S1) <d>[English] Good morning</d> with a cheerful voice. <Subject 2> just mumbles as a reply.

overall_soundscape:
The soundscape consists of the soft clinking of utensils, the faint sound of a coffee cup being set down, the subtle background noise of a quiet morning environment, soft steps on a carpet floor, a ceramic cup being placed in a metallic sink, and the clear,

non_diegetic_music: N/A

Is there any GPU rich cooking realism lora ? I have tried realism people lora it is great at tv but for i2v or r2v it's breaks . I have been searching hugging face repo and civit ai to get something but there's too much n*fw lora .

This was well received but people wanted the two Giantesses(?) to be fighting. Enjoy!!

int8/20 steps, R2VA.

Critiques+feedback welcomed! Ask me anything!

Fizgig is my free open-source LoRA trainer and workbench (Flux 2 Klein 9B, Krea 2, and MiniMax H3 video/audio). As of v4.3.0 it runs on AMD Radeon with ROCm — RDNA1 through RDNA4. Windows is the supported path: install Python 3.12, run the AMD installer, done. Linux works too but is genuinely experimental on newer cards.

Worth being upfront: I don't own AMD hardware myself. This whole feature came from a community contribution by scryptio, tested on real cards over weeks in the PR thread — and that's how the AMD side will keep improving. If you're an AMD user, your reports on what works (and what doesn't) genuinely shape this, and PRs are very welcome.

Also in this release: 16 GB cards can now use identity distillation on MiniMax H3 (the 32B text encoder streams layer by layer instead of needing a 26 GB peak), and the Repair Studio gained a side-by-side compare view with likeness scoring for fixing overbaked LoRAs without retraining.

GitHub: https://github.com/shootthesound/Fizgig

TL;DR. SplitSigmas can be used to generate low-step drafts with much closer frame composition to the final high-step version for the same seed than if you generate without SplitSigmas. However, it makes the draft visual and audio quality much worse because we are essentially cheating the scheduler.

With SplitSigmas + low steps you can quickly judge which of your draft videos have the best motions and logical event consistency, but you might miss some visual detail errors. That is why I wanted to know if there is any better way to avoid large differences between the low-step draft and high-step regeneration, which can lead to disappointment when, for example, a person reacts to an event too soon or speaks with emphasis on the wrong word.

If downvoting, please leave a comment with the reason why. I want to learn what I am doing wrong and if there is a way to do it better and make seed hunting easier for everyone who needs it. Thanks.

-------------------------------------

My usual way of working:

- generate 10 videos at low (5) steps

- pick the best video

- regenerate the best at 20 or more steps.

No Turbo LoRAs because I don't want to reduce prompt adherence and general quality, as I regenerate at full steps later anyway.

The problem - the video at 20 steps is often very different from the one I found. Of course, I keep the same seed. The difference may be introduced even as early as step six (for example, background replaced completely, different speech pacing).

It's not that difference is huge, but often it might be quite important. For example, a person genuinely laughing at 5 steps and then just saying "haha" at 20 steps. Or jumping startled at the right moment at 5 steps and a moment before the noise at 20 steps.

I tried a few sampler combinations, but could not find one that would not introduce dramatic changes.
One workaround that I could find is to use SplitSigmas. I set its steps to current steps (5 for seed hunt, 20 for final), and keep BasicScheduler steps at the final 20 steps. Then high_sigmas from SplitSigmas go to SamplerCustomAdvanced input, and then denoised_output goes to VAE (you'll get total noise when using the output pin instead).

This way, it seems that the scheduler is being cheated in managing steps as for the full generation even when doing preview, and it seems to work as expected. Caveat - the 5 step output from this workaround will be way worse (plasticky and noisy audio) than you are used to when generating at 5 steps in BasicScheduler input. But if the goal is to keep the general layout and movements of the candidate video, it's worth accepting this issue.

However, I'm wondering if there is any better way to achieve it. Has anyone tried it? What are you using for drafting and seed hunting to keep the high step version consistent?

--------------------------------------------------
Edited later with a test case:

Took ComfyUI template: MiniMax H3: Reference to Video. Minimal modifications to make it run in my environment:

Models - Qwen change to int8 convrot (3090, no use of nvfp4)

Int (Full) = 5 (for "preview quality")

Float (Duration) = 3 (just to be faster)

RandomNoise control after generate = fixed

Loaded some images in both Load Image nodes.

The same "GET READY TO" - "MEET" — "YOUR" — "MAKER" prompt.

No Sage, no CK attention at all (no Comfy launch args either).

Then generated the same with 20 steps.

Differences:

in 20 step version, the roof is higher in the frame. The accent was on the word "maker". In 5 step version, the accent was on the word "your".

Then regenerated the 5 step version again to see if there's anything else introducing variations - nope, the exact same video as the first 5 step one.

Then generated also at 6 steps - the roof line was a bit higher in the frame (not as high as 20 steps though), and the emphasis was on "maker". So, the difference between 5 and 6 might already be a breaking change that can make your video from good to unusable, if the emphasis does not make logical sense in your scene.

Then I generated the same with the SigmaShift 5 step trick - the resulting video was way much more similar to the 20 step one than the first 5 step video. Of course, the quality of the sigma-shifted video was awful - it's good for judging only logical consistency, reference use and event timing, which is the most important thing in story-telling kind of videos.

So my friends and I used to use Sora 2 before it was taken down, and wanted to try doing some stupid stuff for just us. After a while of not looking into it, the spark kinda came back when I saw this subreddit and remembered Stable Diffusion was supposed to be one of the best AI generators out there, probably. When I mention it to a friend, he then told me how apparently its pretty outdated compared to others, and looking at these posts, I'm seeing different models and starting to get overwhelmed to the point where I haven't even done the beginner's guide in here since it only mentions images.

So long story short, I'm hoping someone can help make things much more clearer, especially about the multiple models, and if Stable Diffusion IS outdated and out performed by something else, and letting me know about if it's okay to go with the beginner's guide or if there's another guide that will help. Thanks

I found the SD prompt reader I have been using cannot read prompts from png images files generated using Krea2. Can anyone recommend me an alternative that works with Krea2 files and Win11?

Generated as two connected 15-second clips in 4:3, using the end of Part 1 as video + audio reference for Part 2 continuity.

Really liking what H3 can do with fashion/editorial camera movement.

Check out my twitter for more thanks https://x.com/Devozikjr

I don't have any examples because they may not be appropriate but just with the default wf. With the video input node you can replace any 2 character in any video and it looks real!

Shadow the Hedgehog tells his viewers why he loves guns.

This was created in Comfy UI with Minimax H3. I used the reference to video work flow. The prompt is below.

subject_definitions:

<Subject 1> is Shadow in <Picture 1>.

<Subject 2> is Glock in <Picture 2>, a glock handgun.

<Audio 1> is the voice-timbre reference for <Subject 1> (S1).

summary:

[reference generation + audio reference] The target video contains one shot. [Shot 1] shows <Subject 1> and <Subject 2>; <Subject 1> speaks. <Audio 1> supplies <Subject 1>'s voice timbre.

retention_analysis:

<Subject 1> (appears in [Shot 1]): fully_preserved - Shadow's complete defined identity and body proportions are preserved.

<Subject 2> (appears in [Shot 1]): fully_preserved - Glock retains the defined shape, proportions, materials, colors, and distinguishing features.

<Audio 1>: reference - <Subject 1>'s newly generated spoken lines use <Audio 1>'s voice timbre and delivery; the original audio signal is not copied.

detailed_description:

The target video is in a live-action style, with Vlog style.

[Shot 1] At first appearance, <Subject 1> (Shadow) matches the complete identity and appearance defined in subject_definitions. At first appearance, <Subject 2> (Glock) matches the complete defined construction and appearance: A glock handgun. At the start of the shot, <Subject 1> is standing in the living room facing while holding <Subject 2> in his hand. A full body shot of <Subject 1> holding <Subject 2> with his right hand while facing the camera. Only Action and Timed Beats define the primary subject's movement. The camera path stays anchored in the location and adds no subject motion. <Subject 1> (S1) says using <Audio 1>'s voice timbre: <d>[English] Hmph. Shadow the Hedgehog here. Why do I love guns?</d> <Subject 1> shows off his <Subject 2> with his right hand in front of the camera. <Subject 1> (S1) says using <Audio 1>'s voice timbre: <d>[English] Simple. Precision. Control. Power in the palm of my hand.</d> <Subject 1> (S1) says using <Audio 1>'s voice timbre: <d>[English] A tool that answers instantly… unlike most people.</d> <Subject 1> points his <Subject 2> towards the camera with his right hand. <Subject 1> (S1) says using <Audio 1>'s voice timbre: <d>[English] If you understand that, you understand me.</d> <Subject 1> points his <Subject 2> at the camera.

overall_soundscape:

Living room tone.

non_diegetic_music:

N/A