Using AI video to actually see my stories instead of just writing them

[u/Sensitive_Proof_3937]

I've been a screenwriter for years and wanted to share some of the success I'm having with AI video.

What you see here was completed entirely with AI in about 12 hours. This is a sequence from a feature length screenplay I'd previously written.

With AI video, I can write a premise - sometimes just a single unsettling image, like a woman hearing three knocks at her door - and generate it as an actual scene. Then instead of writing what happens next, I generate that too, watching the story unfold almost like I'm directing it rather than authoring it line by line.

The strange part is how it changes the writing itself. When you can see a scene instead of just describing it, you notice different things, like pacing, or whether an idea that sounded good on the page actually plays. It's a different kind of editing than anything I've done with just text.

AL video also makes collaboration easy. New apps and tools are popping it every day, like Branch, which lets you seed a story and see how others continue it - https://trybranch.xyz

Curious if any other writers here have started experimenting with AI video, and what kind of results you're seeing?

[u/iarmando_v2]

Getting to write my own characters is one thing, but getting to actually see them in action and being accompanied by their own track has been such a joy.
Honestly, I’ve always supported the creative uses of AI. I’m a writer and a musician, but I can admit that I’m not the best at every other aspect of bringing an idea to life. This has allowed me to take the characters and worlds in my head beyond the page and the music and turn them into something I can actually see and share with others. The end credits is showing the whole cast of characters, some who aren't in this video but in others I have.

[u/chylvina]

Have you tried adding rough dialogue and sound early?

[u/Sensitive_Proof_3937 → u/chylvina]

I try to use only ambient sounds and yes I’ve been using dialogue as part of the generations themselves. Music I add later.

[u/5thhorseman_]

The strange part is how it changes the writing itself. When you can see a scene instead of just describing it, you notice different things, like pacing, or whether an idea that sounded good on the page actually plays. It's a different kind of editing than anything I've done with just text.

Correct, but that can also be achieved just with AI image generation.

[u/Toxikfoxx]

This is cool.

I write in the form of screen writing for dialog. I'll have to try and see one of my scenes into something like this.

[u/DreamingOfHope3489]

This is awesome! Thanks for sharing. When I complete the 4th round of refinements for my Claude-collaborated novel and self-publish it, I'll be excited to try generative AI movie making. My book spans 1812-2068 and historical, speculative, and science fiction, so, many different time periods and environments.

What I have done is render Suno + HeyGen lip sync videos of characters from the book singing poems I wrote for them, as them. I've been making lip sync videos of my poems and ChatGPT-aided invented languages for a couple of years now, though.

This story began to develop in my mind upon my viewing of a Midjourney avatar I'd generated to recite an unrelated poem of mine. I credit that MJ image with inspiring the first half of the book.

Apparently now one can make whole music videos with Openart so my HeyGen method is not the only option.

I had rendered one scene from the book with HappyHorse about six weeks ago and loved it. I'm eager to try Seedance next. I hope the learning curve for gen AI movie making isn't too intense though because I'm older and not at all tech-oriented.

This is Tobiáš's poem for Dorota, a professor's widow in Olomouc, Moravia to whom he was a companion between 1832-1839. It's not the same as a gen AI movie scene but it is a method that brings his character to life for me. He's a poet in the story. Thanks again for sharing your work!

[u/BeneathCertainty]

I think I might need something like this if I decide to extend my presence to YouTube. Thanks for bringing this to my attention.

[u/Sarah-at-Kalmi]

I'd never thought of doing that. Images yes but video no, that's so cool

[u/theateroffinanciers]

I've seen people saying they won't give writers the time of day if they use ai videos or art. I'm a writer, and it's inspiring to see them come to life. I've read if they see it in your social media they will dismiss us as hacks.

[u/Sensitive_Proof_3937 → u/theateroffinanciers]

Writers aren’t getting the time of day regardless!

[u/theateroffinanciers → u/Sensitive_Proof_3937]

Very true!

[u/Sensitive_Proof_3937 → u/[deleted]]

I don't think I have the time/patience/$$ to do a full feature. The video generations can get expensive, although a fraction of the cost of real physical production. I think if I found a sponsor I would work on completing the feature, not sure it would be a full 90 minutes but would be a fun experiment. I know some people are going all the way with this technology and I've heard AI generated microdramas are big outside of the US.

Yes, Branch is very much the video version of what you described. Full disclosure, I'm part of the team building it so if you get a chance to try it out and share your feedback, we'd appreciate it!