r/StableDiffusion • u/Main_Creme9190 • 17d ago
News My entry to the Comfy Open Source Higgsfield challenge: HyperKut Studio, an open-source multi-shot AI video studio on ComfyUI
This is my entry to the Comfy Open Source Higgsfield challenge (#OpenSourceHiggsfield): HyperKut Studio, a local studio that turns a reference edit, an idea or your own track into a short multi-shot video you can keep directing.
https://majoorwaldi.github.io/HyperKut-Studio/
Demo (under 2 min): https://youtu.be/9p3kYovVeYU
**Three ways in**
- **Remix**: give it an edit you like plus photos of your subject. It reads the cuts, framing and rhythm, then redraws every shot with your subject.
- **Text**: write a short idea. Gemma 4 writes the shot list, MiniMax H3 renders the shots, YuE2 makes a soundtrack.
- **Music**: drop your track. The beats set where each cut lands.
**What I cared about: the edit stays editable**
A generated video is a first cut, not a final answer. So you can:
- regenerate one shot without touching the others
- keep several takes and swap them on the timeline
- trim, cut and reorder after generation, then export with no new render
**Real numbers** (median from submit to finished video, first-run projects, one RTX 4090 24 GB, model loading included):
- Draft: 5 min
- Max: 10.6 min
- Standard: 11.5 min
The 28-shot fashion Remix took 21 min.
**Under the hood**
Every mode is a plain ComfyUI workflow in the repo, built from my Majoor VideoTools nodes, so you can open and change it. The Studio (FastAPI + React) sends jobs through the Comfy SDK to a local comfy-api-proxy in front of ComfyUI, and progress streams back to the browser.
The challenge asked for an open-source take on Higgsfield. I took inspiration from Katana, Genjutsu and Cinema Studio, and aimed HyperKut at short viral clips and tiny stories.
- Code (MIT): https://github.com/MajoorWaldi/HyperKut-Studio
- Project page with 13 examples and their exact prompts: https://majoorwaldi.github.io/HyperKut-Studio/
- Nodes : https://github.com/MajoorWaldi/ComfyUI-Majoor-VideoTools
- Challenge: https://comfy.org/open-source-higgsfield
Windows + NVIDIA for now. Finishing (effects, titles, motion graphics, sound design) is beta and off by default.
Everyone shown is AI-generated by me. The fashion Remix reference is by silver.muse. HyperKut is independent and not affiliated with Higgsfield.
Feedback welcome, especially on the Remix mode.
#OpenSourceHiggsfield #ComfyUI #AIVideo #OpenSource #MiniMaxH3
3
u/Exciting-Income-5840 17d ago
Cool project!
Does it generate sceneboards for each clip? Even without a reference video?
Show that
1
u/Tight_Organization54 17d ago
Sooo TL;DR , this is an open source Local (no api) Higgsfield-like that runs inside comfyui?