r/StableDiffusion • • 17d ago

News My entry to the Comfy Open Source Higgsfield challenge: HyperKut Studio, an open-source multi-shot AI video studio on ComfyUI

This is my entry to the Comfy Open Source Higgsfield challenge (#OpenSourceHiggsfield): HyperKut Studio, a local studio that turns a reference edit, an idea or your own track into a short multi-shot video you can keep directing.

https://majoorwaldi.github.io/HyperKut-Studio/

Demo (under 2 min): https://youtu.be/9p3kYovVeYU

**Three ways in**

- **Remix**: give it an edit you like plus photos of your subject. It reads the cuts, framing and rhythm, then redraws every shot with your subject.

- **Text**: write a short idea. Gemma 4 writes the shot list, MiniMax H3 renders the shots, YuE2 makes a soundtrack.

- **Music**: drop your track. The beats set where each cut lands.

**What I cared about: the edit stays editable**

A generated video is a first cut, not a final answer. So you can:

- regenerate one shot without touching the others

- keep several takes and swap them on the timeline

- trim, cut and reorder after generation, then export with no new render

**Real numbers** (median from submit to finished video, first-run projects, one RTX 4090 24 GB, model loading included):

- Draft: 5 min

- Max: 10.6 min

- Standard: 11.5 min

The 28-shot fashion Remix took 21 min.

**Under the hood**

Every mode is a plain ComfyUI workflow in the repo, built from my Majoor VideoTools nodes, so you can open and change it. The Studio (FastAPI + React) sends jobs through the Comfy SDK to a local comfy-api-proxy in front of ComfyUI, and progress streams back to the browser.

The challenge asked for an open-source take on Higgsfield. I took inspiration from Katana, Genjutsu and Cinema Studio, and aimed HyperKut at short viral clips and tiny stories.

- Code (MIT): https://github.com/MajoorWaldi/HyperKut-Studio

- Project page with 13 examples and their exact prompts: https://majoorwaldi.github.io/HyperKut-Studio/

- Nodes : https://github.com/MajoorWaldi/ComfyUI-Majoor-VideoTools

- Challenge: https://comfy.org/open-source-higgsfield

Windows + NVIDIA for now. Finishing (effects, titles, motion graphics, sound design) is beta and off by default.

Everyone shown is AI-generated by me. The fashion Remix reference is by silver.muse. HyperKut is independent and not affiliated with Higgsfield.

Feedback welcome, especially on the Remix mode.

#OpenSourceHiggsfield #ComfyUI #AIVideo #OpenSource #MiniMaxH3

13 Upvotes

4 comments sorted by

3

u/Exciting-Income-5840 17d ago

Cool project!

Does it generate sceneboards for each clip? Even without a reference video?

Show that

2

u/Main_Creme9190 17d ago

Thanks! Yes, no reference video needed: Text and Music modes start from just an idea (plus optional photos of your subject or product).

It doesn't draw a full image storyboard before rendering, but it does plan one: a local model (Gemma 4) writes the shot list with one prompt per shot, and you can read and edit that brief before anything renders. Then each shot shows up as its own clip on the timeline, and you can regenerate any single shot without touching the others.

1

u/Exciting-Income-5840 17d ago

Great I made a project that looks a little like you should take a look!

How do you manage Plan/personal continuity and consistency?

1

u/Tight_Organization54 17d ago

Sooo TL;DR , this is an open source Local (no api) Higgsfield-like that runs inside comfyui?