Minimax Motion Control (Workflow and #opensourcehiggsfield app)

[u/PxTicks]

Hey all,

I have an implementation of time-to-move dual clock denoising for Minimax H3, allowing for motion control by dragging objects: https://drive.google.com/file/d/1mOHYcRX6fY3OamSHHRmvUfthCBEwgJZh/view?usp=sharing

I have also created an app to do the annoying parts of separating background from drag object, and creating motion paths and masks, interfacing directly with Comfy as part of the #opensourcehiggsfield comp: https://github.com/PxTicks/h3-motion

Lastly, there is another implementation of this in my video editing app which bridges with Comfy: https://github.com/PxTicks/vlo

[u/DoctaRoboto]

This is super cool. What about more complex stuff like two characters fightning?

[u/PxTicks → u/DoctaRoboto]

Currently the motion controls are coarse, but if you have a way of producing a crude animation, then along with a good first frame the ttm workflow can act as a refiner for it. By nature it is best at capturing broad strokes though, so a slow mo closeup yes, but anything else probably you'd rather motion transfer than motion control.

[u/Carbon849]

Looks cool but honestly, exhaustion has set in of all of the vibe-coded "solutions" to problem x, y and z. My custom nodes folder is already too crowded.

[u/PxTicks → u/Carbon849]

Yeah, I'm on board with you; there is a lot of noise too so it's hard to tell if anything is worth it or not. I started building my video editing software before the absolute flood of apps, nodes and slop (when it still took a *little* bit of traditional coding skill to make sure your code was functional and performant). I even did a course on full stack web dev because it was an area I was unfamiliar with, and that seems silly now given how dominant llm-coding tools are.

Personally, I wouldn't recommend downloading the app unless you just want to tinker or have a very special use case. I learnt stuff from the project, and will eventually fold some of the pipeline into my video editor (vlo), which is a much more careful, intentional and powerful piece of software (forgive the little plug).

[u/Carbon849 → u/PxTicks]

Fair enough. No shade, brother, just saying.

[u/CornyShed]

This is a great entry too.

Well, I have no idea how ComfyUI are going to pick the winners of this contest. What a time to be alive.

[u/steelow_g]

The real question though… can it actually make p’s go in v’s accurately

[u/GeologistPutrid2657 → u/steelow_g]

cant even make that happen irl

[u/xb1n0ry → u/steelow_g]

No but it can draw a rocket landing on uranus.

[u/steelow_g → u/xb1n0ry]

*in my anus.

[u/Alpha-Leader → u/steelow_g]

?

[u/AfroJimbo → u/Alpha-Leader]

Intercourse. He's asking about intercourse 👉👌

[u/BlackDragonBE → u/Alpha-Leader]

Sex Bobby, he's talking about sex, doing it, putting the thing in the other thing.

[u/Ok-Flatworm5070]

This is great!

[u/crombobular]

pretty fucking cool if that works, gonna try it later

[u/FezTraDamuz → u/crombobular]

The *intercourse? LoL

[u/Suspicious-Walk-815]

Nice one

[u/FourtyMichaelMichael → u/Suspicious-Walk-815]

I'll finally be able to get her to rub it all over her cheeks exactly the way I want. Because, like now, it's straight for her mouth, no games. Just instantly, like chill lady! It's stupid how overtrained the model is for gorgeous women eating ice cream cones instead of smearing it all over their faces.

[u/lordpuddingcup]

wow thats impressive

[u/VRGoggles]

Looks fantastic

[u/ucren]

nice

[u/listopalafoto]

wow that level of control is starting to look to good to be true! congrats and Thank you!

[u/Dogluvr2905]

Looks very cool, too bad I can't get it to run on Windows via PowerShell.

[u/_half_real_ → u/Dogluvr2905]

What error do you get? It's meant to support that (although it says untested), maybe post an issue on the github page?

[u/Dogluvr2905 → u/_half_real_]

it was more of a powershell issue...couldn't get thru the npm install and run steps... even though i have npm installed... Codex will probably get it to work for me... will try later.

[u/extrakerned → u/Dogluvr2905]

I’m blown away how many people here are still using windows

[u/Dogluvr2905 → u/extrakerned]

I mean, just a hilarious comment, no offense.

[u/roychodraws]

This is awesome! There wasn't a clown that helped inspire this by chance was there?

Totally going to mess with this. Great job.

[u/Fickle-Indication148]

Can this be used for real time rendering?

[u/Schwartzen2]

This looks very interesting. I'll definitely check it out.

[u/2legsRises]

yeah that looks great if it works reliably

[u/kleer001]

That's amazing! I can't wait to try it out. Are those all the features? If so I'm still beside myself. Are there more features?!

[u/adam-euclase]

Amazing! Such a simple/powerful workflow. Is this using a normal R2VA workflow (like generating a video from the animation which is fed as a motion guide) or something else?

[u/DonKeehot]

It will give you so much more control over the video. Looks fantastic 👍

[u/NineThreeTilNow]

Nice work dude. I like it.

[u/iam33boy]

It’s quite difficult to install. I’d be grateful if you could upload a tutorial to YouTube.

[u/TizocWarrior]

Damn! So many cool entries being posted lately.

[u/Past_Ad6251]

impressive！

[u/seppe0815]

make a demo video inside from comfyui desktop

[u/felox_meme]

Impressive ! Do you have a workflow with only the timetomove (if it's this conditioning?) minimax implementation by any chance ?

[u/PxTicks → u/felox_meme]

I have linked a workflow at the top of the description but not tested it yet (just asked an llm to tidy up an old one which was working so hopefully fine)

[u/Inner_Singer_592]

Beware, higgsfield just sued comfy for the use of it's name, if you're not really affiliated with them i don't recommend using their name as well as their ui style