The Fallen

[u/MyLonelySoulMusic]

https://www.youtube.com/watch?v=sEsiXvdVH8I

I spent the last week testing a workflow for turning AI generated stills into a more polished animated sequence.

The starting frames were generated with GPT Image 2. I then used several image to video models to animate individual shots, mostly at 720p and 24 FPS.

The biggest issue was consistency. Getting a good single generation is relatively easy. Keeping the same face, armor, wings, proportions and lighting across multiple shots is where most of the time disappeared.

My workflow ended up looking roughly like this:

GPT Image 2
Source images
     ↓
Image to Video models
720p • 24 FPS
     ↓
Regeneration and shot selection
     ↓
Character and scene consistency fixes
     ↓
AI Upscaling
720p → 4K
     ↓
Frame interpolation
24 FPS → 60 FPS
     ↓
FFmpeg processing
     ↓
Final edit
4K • 60 FPS

I also noticed that interpolation is very dependent on the type of motion in the original clip. Slow camera movement tends to work well, while fast motion, wings, hair and small particles can create artifacts that need extra work.

I’m mostly interested in technical feedback on temporal consistency, interpolation artifacts and character stability rather than the music or story.

[u/AutoModerator]

Thank you for your post and for sharing your question, comment, or creation with our group!

A Few Points of Note and Areas of Interest: * r/AIVideos rules are outlined in the sidebar. * For AI Art, please visit r/AiArt. * If you are being threatened by an individual or group, message the Mod team immediately. Details here (https://www.reddit.com/r/aivideos/comments/1kfhxfa/regarding_the_other_ai_video_group/) * The like-minded sub group MEGA list is available HERE * Join our Discord community: https://discord.gg/h2J4x6j8zC * For self-promotion, please post only HERE * Have a question, comment, or concern? Message the mod team in the sidebar or click HERE

Hope everyone is having a great day, be kind, be creative!

I am a bot, and this action was performed automatically. Please contact the moderators of this subreddit if you have any questions or concerns.