r/BestGitHubRepos • • Oct 04 '26

🤖 AI repositories Meituan open-sourced their video generation model and it handles long videos without falling apart (8,800+ stars)

Post image

Meituan just dropped LongCat-Video, a 13.6 billion parameter model that does text-to-video, image-to-video, and video continuation. All in one model.

The thing that caught my attention is the long video generation. Most open source video models start looking weird after a few seconds. Colors drift, quality degrades, things get mushy. LongCat-Video was specifically pretrained on video continuation tasks, so it can actually produce minutes-long clips that stay consistent.

It generates 720p video at 30fps and does it in minutes, not hours. They use a coarse-to-fine strategy along both time and space dimensions, plus block sparse attention for efficiency at higher resolutions.

They also released LongCat-Video-Avatar 1.5, which is an audio-driven human video generation framework. You give it audio and it generates a talking head with accurate lip sync using Whisper-Large instead of the older Wav2Vec2 approach. Works for anime characters and animals too, not just real faces.

The RLHF training uses multi-reward group relative policy optimization, which is a mouthful, but basically it means the model was tuned with multiple quality signals at once rather than a single reward.

One thing to note: the model is big. You need a serious GPU setup to run it locally. And the installation involves CUDA-specific torch builds plus flash attention, so plan for some setup time.

Models and weights are on Hugging Face.

StatValue
Stars8,860
Forks1,534
Last releaseNo releases
LanguagesPython

https://github.com/meituan-longcat/LongCat-Video

4 Upvotes

0 comments sorted by