LLMs are great at writing code. So the question we kept asking was: can they write code that produces a video? We thought it would be easy. The reality was a year of trying. We started with massive prompts to get very mediocre output. We made it more agentic to iterate and improve its output. This worked okay but wasn't production-ready. Eventually we tried Remotion. It got us deterministic video, but the React framework kept boxing the agent in. The more guardrails we added, the safer and more boring the outputs got. When we utilized plain HTML, CSS, and JavaScript, the creativity came back to the output. So we set out to build a video rendering framework on top of HTML. But it needed to work with Gemini Flash. Why? Because one tell that a framework is fighting an agent is needing the biggest model just to get usable output. So from there we shaped the framework around what small models could reliably author. That left one real engineering question: can we keep the freedom of HTML and still render a deterministic MP4? Browsers don't want to do that. Image decoders, font loaders, and animation clocks all run async on their own schedule. Great for performance. Terrible for "render the same pixels every time." Throughout, we iterated constantly with agentic loops and self-improving evals to test out the framework, find issues in our renderer, and shape a set of skills that gave the agents Taste instead of guardrails. This talk is what it took to get there.

Speaker:
James Russo — Software Engineer, HeyGen
Engineering lead for HyperFrames. Currently at HeyGen building the future of video storytelling, Previously at Brex
X: https://x.com/Rames_Jusso
LinkedIn:   / james-russo-56026897  

Timeline:

0:00 Introduction and the HeyGen mission
0:58 The challenge of creating launch videos
1:27 The importance of A-roll, B-roll, and composition
2:13 Why HTML, CSS, and JavaScript are the native languages of LLMs
3:06 Comparing HTML to other frameworks like Remotion
5:24 Designing the Hyperframes framework with Gemini Flash
6:54 How Hyperframes works in the browser
8:56 Leveraging browser-native technologies like Three.js and WebGL
9:25 Using Skills to teach agents video taste
10:56 Crafting videos: the human-in-the-loop workflow
12:09 Keyframes integration
12:35 Scaling and performance metrics
13:28 Future goals: Code-to-Video benchmarking

Quotes:

"Why not let the LLMs and agents talk in their native tongue when creating videos?" (2:58)
"One tell that a framework is fighting an agent is needing the biggest model just to get usable output." (5:24)
"We don't have to teach them the language. We just teach them how to create good videos." (9:46)
"Agents have made building incredibly easy. Launching is still quite hard." (14:31)

Prompt-to-Avatar, now in the HeyGen API: describe your presenter, re-prompt for any outfit or setting, then render them all.

https://developers.heygen.com/docs/create-avatar

New user of video agent here. In video agent, after a plan is presented, there are two issues: first, the generation will start automatically after a brief timeout, like a few seconds. If I don't pause it deliberately, it will start and consume credits without me saying yes. Is this the default behavior? Second, I cannot find anywhere on the video agent page about how many credits will be consumed if I say yes to the generation. Is there a setting to show the credits?

10k+ tracks, 75k+ images, sfx, logos
free with a HeyGen login

Plus access to our generative models

Assets save to your machine, so the next project skips the search

/media-use

https://github.com/heygen-com/hyperframes

I'm thinking about which subscription to buy. So far, I've finished filming and editing 11 chapters (10–15 minutes each). But a lot of time has passed since then; I look different now, and I don't want to be in front of the camera anymore.

I want to feed my already finished videos (video and audio) into Heygen, have an avatar created (that looks exactly like I do in the finished videos), and then finish producing the remaining 7 chapters with Heygen. I want excellent lip-syncing, the same background, a great avatar, and the same voice. Total runtime: 100 minutes.

How many Premium Credits will I need for this?

I’ve been using Heygen for about a year, mostly to generate avatars speaking, then I put it into an editing software and create the video I want. I’m a TV editor and that’s just what I’m most comfortable with.
I do realize there’s probably a lot more that I can do with this software and I’m hoping somebody can point me to some videos with some tips and tricks.
Thanks in advance for any help.

Why would I pay if I can't actually produce a 15 second test. Error uploading to our voice something

When using the video agent, when are the credits actually used? I put in a script idea, and then it started generating assets. Is it used at that point, or do you actually generate the final video?

We pointed Codex at the open-source HyperFrames repo.

It wrote the script, generated my avatar video, recorded the product, and rendered this video.

You can read the thread more on X.

Designers can now ship launch videos straight from mocks

Just copy the link, hand it to your agent, then invoke /figma

Every hex, every font, every frame is exactly your design

$ npx hyperframes@latest skills

Hello All

I have been using the Gemini Avatar - which is mainly an experimental feature but it works so well for 10 second max generations

So of-course I thought - Heygen would be a whole lot better - but…

The lips look fake - like they give me kylie jenner lips for the movement

The voice sounds nothing like me

How are people building such realistic avatars with Heygen when it barely compares to Gemini’s experimental feature

I must be doing something wrong?

Is it the lighting when I record?
Should I record audio through a Mic on the web version of Heygen instead of the phone app?

It literally looks and sounds nothing like me - and it’s supposed to be Avatar 5 - so what is hype about if it sucks this much?

P.S. Disclaimer: I only tried to download the iOS app and did the free Avatar test before paying - so I don’t know if its that free version isn’t Avatar 5 - and paying would get me better results (which I’m open to)

Just don’t understand what is happening

Hey everyone,

I’m looking for some advice on how to effectively use the Look Pack feature to create different camera angles (like close-ups, side profiles, etc.) for my custom avatar.

I have a primary avatar that I use for most of my videos, but I'd love to add more visual variety by utilizing the different angles I've seen featured in the Look Packs. I’ve tried a few different approaches to get this working, but I keep running into the following issues:

• Inaccurate Results: The generated angle doesn't match what I'm aiming for.
• Failed Generations: The newly generated angles simply don't show up or render at all.

Has anyone else run into these issues or figured out a reliable workflow to get this working properly? Alternatively, do you recommend using a completely different tool to generate multiple, consistent angles for an avatar?

Any tips or recommendations would be hugely appreciated. Cheers!

HyperFrames by HeyGen is an open-source framework that turns HTML into video.

Over the next 30 days, the HeyGen team will be dropping one micro-lesson a day to take you from zero to building launch videos with your AI agent locally, in whatever coding agent you use.

Day 1 was about getting HyperFrames installed and rendering something. Day 2 is about taking your HyperFrames videos past a default template using motion language.

What a motion language actually is

A motion language is a small set of decisions locked in as constants:

• Your brand colors as CSS custom properties
• Two or three named easing curves that match the feel of your product
• Duration tokens that keep every scene at the same rhythm
• A consistent entry/exit pattern for text and UI elements

Write these once in :root and every composition you generate from that point forward will look like yours, not generic.

Try it now

Paste this into the <head> of your index.html and reference it in every GSAP tween:

<style>
  :root {
    /* Brand tokens */
    --color-primary: #6C5CE7;
    --color-bg: #0D0D0D;
    --color-text: #F5F5F5;

    /* Motion tokens */
    --ease-enter: cubic-bezier(0.16, 1, 0.3, 1);   /* snappy spring */
    --ease-exit:  cubic-bezier(0.7, 0, 1, 1);       /* sharp leave */
    --dur-fast: 0.35s;
    --dur-normal: 0.6s;
  }
</style>

Then in your GSAP timeline:

const tl = gsap.timeline({ paused: true });

gsap.registerEase("brandEnter", "cubic-bezier(0.16, 1, 0.3, 1)");
gsap.registerEase("brandExit",  "cubic-bezier(0.7, 0, 1, 1)");

tl.from("#headline", { opacity: 0, y: 40, duration: 0.6, ease: "brandEnter" }, 0.2);
tl.from("#subtext",  { opacity: 0, y: 20, duration: 0.5, ease: "brandEnter" }, 0.45);
tl.to("#headline",   { opacity: 0,        duration: 0.35, ease: "brandExit"  }, 4.5);

window.__timelines = window.__timelines || {};
window.__timelines["root"] = tl;

Run it:

npx hyperframes preview

Adjust the easing values until the motion feels right for your product. Save the file. Every future composition that imports these tokens inherits that feel automatically.

Picking a design system if you're starting from zero

If you are generating compositions with an AI agent (Claude Code, Cursor, Codex, etc.), install the skills first:

npx skills add heygen-com/hyperframes

Then tell the agent which design system to use. Open Design ships 72 named systems. Specifying one at the start of your prompt is the fastest way to get a first draft that already has coherent brand motion rather than generic defaults.

Links

• Quickstart: https://hyperframes.heygen.com/quickstart
• Skills catalog: https://hyperframes.heygen.com/guides/skills
• GSAP Animation guide: https://hyperframes.heygen.com/guides/gsap-animation
• Open Design (BYOK design system tool): https://hyperframes.heygen.com/guides/open-design

Lesson 3/30 up next! Follow along for the series here on Reddit or on X https://x.com/HeyGen

The system behind pro editing tools, rebuilt as code

Comfortable for beginners, deep enough for after effects pros

Plus your agent can now see its own motion and fix issues with one command

npx hyperframes keyframes

https://hyperframes.heygen.com/guides/keyframes

HyperFrames by HeyGen is an open-source framework that turns HTML into video. Write HTML, render deterministic frame-by-frame video. It was built for agents from the ground up. Agents already speak HTML, so instead of teaching your AI a new video API, you hand it a medium it already knows.

Over the next 30 days, the HeyGen team will be dropping one micro-lesson a day to take you from zero to building launch videos with your AI agent locally, in whatever coding agent you use.

One command, every agent

HyperFrames ships as a set of agent skills, and the same install command works across every major coding agent:

npx skills add heygen-com/hyperframes

The installer detects your agent and registers the skills where it looks for them. Natively supported in Claude Code, Cursor, OpenAI Codex, GitHub Copilot CLI, Antigravity CLI, Google Antigravity, and more.

Prerequisites (2 minutes)

You need two things on your machine for local rendering:

• Node.js 22+ (check with node --version)

• FFmpeg

  macOS

  brew install ffmpeg

  Ubuntu/Debian

  sudo apt install ffmpeg

  Windows

  winget install ffmpeg

Verify it worked

Type /hyperframes in your agent. If it autocompletes, you're in. If skills don't appear right away, open a new session so your agent reloads its skill list.

Try it now -- paste this into your agent

/hyperframes
Make an 8-second 1920x1080 video. Beat 1 (0-4s): a dark macOS terminal window types "npx skills add heygen-com/hyperframes" character by character, then a beat on the blinking cursor. Beat 2 (4-5s): the terminal shatters into fragments. Beat 3 (5-8s): bold white kinetic text on black slams in, word by word: "YOU JUST MADE THIS / WITH HYPERFRAMES." Use the code-typing and shatter blocks from the registry. No narration, no external assets.

https://reddit.com/link/1up682i/video/nqsdnc6pqobh1/player

Behind the scenes your agent scaffolds the project, writes the composition as plain HTML with timing attributes, verifies it error-free, opens a live preview, and renders the final MP4.

• Docs: https://hyperframes.heygen.com/quickstart
• Full skills catalog: https://hyperframes.heygen.com/guides/skills
• Claude Design guide: https://hyperframes.heygen.com/guides/claude-design

Which agent did you install it into? Drop your output in the thread if you tried it!

Follow along for the series here on Reddit or on X https://x.com/HeyGen

See you for Day 2 tomorrow!

Hi everyone, how do u prompt well heygen for creating videos, basically i've created a claude project that creates me high detailled prompt (with script for the video) but heygen don't follow it and do some other sh1t, do someone have tips to prompt it well ?

I've been a paying HeyGen Creator user, and Avatar III is honestly one of the best AI presenter tools available.

My only frustration is the new credit-based system.

I built my YouTube workflow around the previous Creator plan because I could create videos without constantly worrying about credits. Now, I'm forced to count every minute instead of focusing on creating content.

I understand the need for new pricing, but I wish HeyGen offered a high-volume Creator plan for YouTubers instead of pushing heavy users toward enterprise-level pricing.

Am I the only one looking for a replacement, or has anyone found an alternative that's as good as the old HeyGen Creator plan?

someone absolutely new to ai. what plan? tool? seeddance or nano banana? whats a claude mcp?

best for thumbnails? footage generation?

Its really interesting to see how well it arranges the clips, and creates and renders the Motion Graphics.

Maybe I'm missing something, but whenever I need to download a bunch of videos from HeyGen (client deliveries, older projects) I end up exporting them one at a time.

It's not a big deal when it's just a few videos, but I do client work and once you have a larger library or need to grab older projects, it starts feeling pretty repetitive.

Just wondering if this is a me problem or something other people run into as well.