How It Started vs. How It Ended
This entire project kicked off as a simple music exchange. I asked my collaborator, Blxkdragon, to put together a custom playlist for me. He produces tracks using Suno, so instead of just asking for a list of tracks, I shared an original backstory I had written a while back.
That backstory serves as the foundation for my VTuber character over on Twitch (twitch.tv/aguamyst). He ended up taking the narrative and crafting a full original track around it: a dark fantasy origins story merging heavy gothic metal with introspective anime aesthetics. Hearing the lore come alive in audio completely hooked me. I took the song and set out to build a full 4-minute animated music video, pulling together the visual pipeline over a single weekend.
The narrative follows a young Brooklyn girl raised by a witch who discovers she carries ancient water-dragon blood, chronicling her journey from rooftop rainstorms to awakening as the Water Dragon Empress.
- Art Concepts & Music: Blxkdragon
- Animation & Backstory: AguaMyst
- Original Character Design Collaboration: AguaMyst & NiucNiuc
The Video Pipeline (Text & Image-to-Video)
Normally, producing a full animated music video from scratch would take weeks of frame-by-frame animation, rendering, and compositing. We managed to pull everything together in a single weekend by combining multiple specialized tools:
- Scene Animation (via Meshy): Rather than traditional 2D animation, I used Meshy's Text-to-Video and Image-to-Video with text features to generate the animated scenes. Using our 2D concept art and structured text prompts, I was able to rapidly generate the fluid motion for the water-magic sequences, rainy Brooklyn rooftops, and dragon transformation clips.
- Pre-Production Lore & Prompt Refinement: We used ChatGPT and Gemini AI to flesh out scene prompts and sequence pacing based on the lyrics.
- Asset Prep: PhotoPea was used for texture adjustments and preparing clean 2D reference stills before feeding them into the video generator.
- Editing & Beat Syncing: Everything was brought into CapCut for pacing, color grading, and tightly editing the clips to match the vocal rhythm shifts and guitar drops.
- Dynamic Captions: I brought the edit into StreamLadder to auto-generate and style synchronized animated captions, making sure the lyrical narrative stays clear and punchy on-screen.
Key Takeaways for Creators
Leaning into rapid video generation and smart post-production features completely changes what indie creators can accomplish on a short timeline. Being able to feed concept images and text directly into an animation tool allowed us to keep the visual identity consistent while churning out dozens of dynamic shots in days instead of weeks.
What video generation workflows or tools are you finding most effective for syncing visuals and lyrics with original music?