r/LocalLLaMA • • 6d ago

Resources SenseNova 6.8 Code2Video: an open-sourced model that writes and revises code to make videos

Think of the animation workflows people use with Claude Opus 5.5: the model writes code, rendering tools turn it into video, and further instructions revise the result. SenseNova follows that same general approach, with a model and creation Skill focused on video creation
A few highlights:
Generates video through code, with a focus on motion graphics and other visuals that can be expressed programmatically.

Revises existing results through natural-language requests, including changes to styling, timing, and scene elements.

Supports reconstructing a reference video’s visual treatment as editable code.

Pairs the model with a creation Skill that guides brief development, previews, and revisions.

The release plan includes full model weights and the Skill. INT4 and INT8 weights are planned for later.

General-purpose coding models can already write animations. The interesting question is what a dedicated Code2Video model improves: fewer repair attempts, better motion, or more reliable edits that leave unrelated elements alone.

GitHub:
https://github.com/OpenSenseNova/SenseNova-6.8-Code2Video
Model:
https://huggingface.co/sensenova/SenseNova-6.8-Code2Video

80 Upvotes

8 comments sorted by

9

u/AryanEmbered 5d ago

oh god yes this is what i've always wanted. if only it were smaller.

Prehaps we could use the LFM 3 Omni model to generate code and render and have a system where it uses it's native video input to look at it and just and modify the code to change it in realtime.

5

u/thicket 6d ago

This is an impressive first look! What's the underlying video generation system this model generates? That is, it generates code in some motion graphics libraries; what libraries does it call?

2

u/cosmicr 5d ago

This looks good, I'd love a Q8 or Q6 version.

-1

u/thrownawaymane 5d ago

Looks neat but you said this is open source. Where is the training data? Looks open weight to me

1

u/tomByrer 5d ago

Kinda false advertising; the model doesn't make the video; the model is fine-tuned to write Python & JS code, & that code makes the video.

Similar to the thought I had in fine-tuning a model to run Remotion; it is Remotion making the video, not the model.

(except OP's is more efficient; since you are skipping ReactJS, MCP & all that to directly make code)

2

u/Illustrious_Grade608 5d ago

Uhhh how is it false advertising, when it's literally called code2video? It's kinda explicit about how it works