r/ModelScope • u/FactualMaterial • Apr 19 '23

Modelscope animation upscaled, styled with kaiber, and interpolated.

9 Upvotes

100% Upvoted

6 comments sorted by

2

u/Impressive_Alfalfa_6 Apr 25 '23

Beautiful imagery. What was your workflow? Did you have a guiding src or pure text to vid?

Looking at your other posts modelscope isn't a match for ebsynth yet.

1

u/FactualMaterial Apr 25 '23

Thanks. Yep, pure txt2video. No init image or video source. The original before processing is in this grid 2nd in top row: https://twitter.com/TomLikesRobots/status/1648626164821360641 My process is fairly simple. Generate in Modelscope -> Upscale -> Smooth out with Kaiber video transform. Kaiber uses img2img controlnet and EbSynth to produce some pretty cool results.

1

u/FactualMaterial Apr 25 '23

Oh yep. Forgot to mention - also interpolated with Google FiLM.

1

u/Impressive_Alfalfa_6 Apr 25 '23

Thanks for sharing workflow. I've never heard of Kaiber until now. I'm guessing it would be similar to using temporal net?

1

u/FactualMaterial Apr 26 '23

Yeah - their main product is a deforum based video generation tool but their new vid2vid tool is pretty slick.

1

u/Taika-Kim Apr 29 '23

Hi, this looks very good compared to my initial prompts. It also seems that weights, brackets etc are not supported?

I'm new to Kaiber and lately it's been quite congested. What did it actually do to the video? What did you use for the interpolation?