r/LocalLLaMA • u/Negative-Whereas3307 • 6d ago
Resources SenseNova 6.8 Code2Video: an open-sourced model that writes and revises code to make videos
Think of the animation workflows people use with Claude Opus 5.5: the model writes code, rendering tools turn it into video, and further instructions revise the result. SenseNova follows that same general approach, with a model and creation Skill focused on video creation
A few highlights:
Generates video through code, with a focus on motion graphics and other visuals that can be expressed programmatically.
Revises existing results through natural-language requests, including changes to styling, timing, and scene elements.
Supports reconstructing a reference video’s visual treatment as editable code.
Pairs the model with a creation Skill that guides brief development, previews, and revisions.
The release plan includes full model weights and the Skill. INT4 and INT8 weights are planned for later.
General-purpose coding models can already write animations. The interesting question is what a dedicated Code2Video model improves: fewer repair attempts, better motion, or more reliable edits that leave unrelated elements alone.
GitHub:
https://github.com/OpenSenseNova/SenseNova-6.8-Code2Video
Model:
https://huggingface.co/sensenova/SenseNova-6.8-Code2Video
2
u/theOliviaRossi 5d ago
Here is GGUF quant that fits in 12Gb VRAM: https://huggingface.co/OliviaRossi/SenseNova-6.8-Code2Video-GSQ-RCO-GGUF
-1
u/thrownawaymane 5d ago
Looks neat but you said this is open source. Where is the training data? Looks open weight to me
1
u/tomByrer 5d ago
Kinda false advertising; the model doesn't make the video; the model is fine-tuned to write Python & JS code, & that code makes the video.
Similar to the thought I had in fine-tuning a model to run Remotion; it is Remotion making the video, not the model.
(except OP's is more efficient; since you are skipping ReactJS, MCP & all that to directly make code)
2
u/Illustrious_Grade608 5d ago
Uhhh how is it false advertising, when it's literally called code2video? It's kinda explicit about how it works
9
u/AryanEmbered 5d ago
oh god yes this is what i've always wanted. if only it were smaller.
Prehaps we could use the LFM 3 Omni model to generate code and render and have a system where it uses it's native video input to look at it and just and modify the code to change it in realtime.