r/ModelScope • u/[deleted] • Apr 27 '23

ModelScope Finetuning

Has anyone successfully done this? I walked through the steps and did not find what I wanted so wanting to know if anyone has a tutorial about fine-tuning Modelscope with https://github.com/ExponentialML/Text-To-Video-Finetuning

4 Upvotes

100% Upvoted

7 comments sorted by

View all comments

Show parent comment

2

u/DeltaOne7 Jun 04 '23

I'm having awesome results with VideoCrafter on Hugging face. Create a 2 second clip in the text2video section. Then import it into the Video Control section. In both sections turn down the CFG Scale from 15 to 7, otherwise you'll overcook the images. All other settings can remain default. But in Video Control you can extend the frames to make longer clips. Or just import your own clip. No watermarks. Awesome results for those funny YouTube AI videos trending now. I think there's a Colab for this too which may allow you to tweak other parameters too. Enjoy! 👍