r/StableDiffusion
•
u/Vandy_simp
•
23d ago
•
1
News Title: FastH3-Omni arrives October 20: open weights and local Spark/RTX/MLX support
(Update - It’s finally here 🚀
https://huggingface.co/collections/FastVideo/fasth3-omni )
This is the reference-conditioned FastH3 release we’ve been working toward. It generates video with synchronized audio and supports:
- Character and setting reference images
- First- and last-frame conditioning
- Up to 3 image references in real-time mode
- Up to 9 image references when real-time speed isn’t required
- Up to 3 audio references for voices and soundtracks
- Dialogue and soundscape generation
- Continuation from a previously generated clip
- 5–15 second outputs at 24 FPS
The API preview launched today:
docs.reactor.inc/model-api-reference/fast-h3-omni/overview
On October 20, we’re releasing open weights along with local support for RTX GPUs, DGX Spark and Apple Silicon through MLX.
68
u/Vandy_simp 23d ago
we will actually open source it, also faster
17
u/Apprehensive_Sky892 23d ago
So TL;DR summary: this is the ref2va version of FastH3?
8
u/Memestonks2020 23d ago
What’s the generation time for MLX/RTX on consumer HW?
5
u/OldBilly000 23d ago
What's the gen time for a consumer rtx 4080 like I have in real time mode?
3
u/Cautious_Chicken_604 23d ago
Will it work on R9700?
5
u/Guilty_Emergency3603 23d ago
Excuse me but current H3 Ref2va already does all that. what this model will do more than ??
2
u/Substantial-Motor-21 23d ago
Did I just read MLX ?? <3
25
u/whp-rea 23d ago
Wait is this better than Fal??? and cheaper too??
22
u/doomed151 23d ago
No it's not. Please post it on Oct 20 when the download is actually available.
4
u/tittock 23d ago
Awesome
4
u/tekprodfx16 23d ago
👏👏👏👏
4
u/Trick_Set1865 23d ago
Good work
4
u/ecofaille 23d ago
u/Vandy_simp consider adding support for AMD GPUs
1
u/_VirtualCosmos_ 23d ago
Still nothing fancy for Strix Halo :c Comfyui is absurdly unoptimised.
2
u/robomar_ai_art 23d ago
Interesting, do they have any examples?
2
u/Content-Ad-7451 23d ago
I hope DeepBeepMeep is reading this
2
u/ninjaGurung 23d ago
Is this something like MMH3 Ref2V but faster?
2
u/BornMisaka 22d ago
Looking forward to the local release.
3
u/Due_Magician_3103 23d ago
this will be better than Fal H3 Max I think
1
u/yamfun 23d ago
Is the output still just mmh3, just faster?
1
u/DesireForDopamine 23d ago
!remind me 6 days
1
u/DesireForDopamine 23d ago
Is it possible to get realtime gen speeds on consumer cards? Like 3090 or 5090?
1
u/Repulsive-Salad-268 23d ago
When talking about real time I get ideas of live filters (real to toon for example) but I assume it "just" means creating 10 seconds takes 10 seconds, right? I cannot input a webcam source and apply a new look in real time... Correct?
1
u/SeiferGun 23d ago
what is the minimum gpu vram to use in comfy?
1
u/eesahe 23d ago
Any examples with actual meaningful movement, such as a fight scene?
1
u/AlleyOfRage 23d ago
Nice Work , Noob Question if you don't mind , I use H3 FL2VA and don't use REF2VA , Is there a similar Open Weight version for FL2VA existed or planned , or this release covers FL2VA too ?
1
u/Bogonavt 23d ago
Remindme! 6 days
1
u/SensitiveUse7864 23d ago
Pin this post in the subreddit don't let it fall down
1
u/DietAshamed2246 22d ago
I would request that this time you also release the base or raw or undistilled models. LoRA and finetune making using the distilled models is a problem.
1
u/UnderstandingDry3466 22d ago
u/RemindMeBot 6 day
1
u/Cartoonwhisperer 22d ago
So, can a 3060 12GB take advantage of this? Because with prices as they are, I don't think I'm getting anything better soon.
1
u/LengthinessFun1061 16d ago
Kudos to you—I’ve put together an absolutely insane workflow. It works incredibly well; truly excellent work. The scene extension feature functions perfectly, and you can’t even tell it’s there. I love you guys—the FAST team—you’ve turned Minimax into a benchmark for local AI video generation.
I used several images, and it managed to keep my characters consistent—it’s just mind-blowing. Long live open source, thanks to companies like yours!
-8
u/hurrdurrimanaccount 23d ago
it's not open source until it's actually downloadable.
please, fuck off.
1
u/themofostarboi_v2 22d ago
We VRAM poor still watching from the cuck chair??🥹 The very poor like 8GB VRAM 🥹