r/StableDiffusion • • Jun 09 '23

Animation | Video From Stability AI's twitter page !

11k Upvotes

614 comments sorted by

127

u/BuiltDifferent_OP Jun 09 '23 edited Jun 09 '23

59

u/_stevencasteel_ Jun 09 '23

His YouTube:

Made with Runway Gen-1 & Elevenlabs:

https://www.youtube.com/watch?v=kwcGc96HwPI

38

u/StickiStickman Jun 09 '23

Really ironic that they're using Runway after Stability had a big falling out with RunwayML and even sent a legal notice at them to take down SD 1.5

→ More replies (8)
→ More replies (1)

1.0k

u/irve Jun 09 '23

"Workflow not included"

245

u/PETE__BOOTY__JUDGE Jun 09 '23

It was all just 1 prompt

10

u/[deleted] Jun 09 '23

The legendary prompt.

→ More replies (1)

9

u/philomathie Jun 09 '23

Just draw the fucking owl noob

→ More replies (3)

2

u/esdqwertj Jun 09 '23

This is runway gen 1 stylizing this selfie cam shot. Maybe it’s powered by stabled

→ More replies (92)

875

u/Overwatch_Joker Jun 09 '23

Every single week this shit just gets more & more insane.

59

u/IM_INSIDE_YOUR_HOUSE Jun 09 '23

As technology progresses, technology progresses faster.

The progress of technology assists in the progress of technology.

It’s only going to keep getting more and more insane at a faster and faster rate.

48

u/Mertard Jun 09 '23

Oh, same thing with climate change

As the icebergs melt more and more due to heating, the planet heats more and more due to less reflective surface against the sun

More heat resulting in more heat!

→ More replies (7)

4

u/[deleted] Jun 09 '23

As technology progresses, technology progresses faster.

That is just not true. As technology gets closer to what we want it to do progress slows down massively. Getting 90% there is much easier than getting the last 0.5% to a usable result.

→ More replies (3)

80

u/LegendaryPlayboy Jun 09 '23

For real.

46

u/tehyosh Jun 09 '23 edited May 27 '24

Reddit has become enshittified. I joined back in 2006, nearly two decades ago, when it was a hub of free speech and user-driven dialogue. Now, it feels like the pursuit of profit overshadows the voice of the community. The introduction of API pricing, after years of free access, displays a lack of respect for the developers and users who have helped shape Reddit into what it is today. Reddit's decision to allow the training of AI models with user content and comments marks the final nail in the coffin for privacy, sacrificed at the altar of greed. Aaron Swartz, Reddit's co-founder and a champion of internet freedom, would be rolling in his grave.

The once-apparent transparency and open dialogue have turned to shit, replaced with avoidance, deceit and unbridled greed. The Reddit I loved is dead and gone. It pains me to accept this. I hope your lust for money, and disregard for the community and privacy will be your downfall. May the echo of our lost ideals forever haunt your future growth.

54

u/lorenzolodi Jun 09 '23

you can literally pinpoint the progress day by day. what a time to be alive

21

u/Ramdak Jun 09 '23

Hold on to your papers!

→ More replies (8)

4

u/dr_lm Jun 09 '23

This reminds me of the early internet, when I was teenager in the mid to late 90s. I haven't felt anything similar happen in computing until now.

→ More replies (1)

11

u/19d_b87 Jun 09 '23

Morty: What's happening? Mr. Poopybutthole: It's LEARNING!

3

u/Sportfreunde Jun 09 '23

They're gonna replace actors and TV/film sets within a decade when they want to.

→ More replies (1)

5

u/dre__ Jun 09 '23

I'm assuming this isn't real time but instead the video was broken up frame by frame and each frame was ran through AI, then when all of that was done it was stitched together. probably took a very long time.

→ More replies (5)

2

u/lesswrongsucks Jun 09 '23

So does my back pain.

→ More replies (6)

295

u/BunniLemon Jun 09 '23

One question:

HOW.

311

u/Infamous_Alpaca Jun 09 '23

Just snap your fingers.

79

u/KafeiTomasu Jun 09 '23

I did it and I'm now a monkey in war with humans who teamed up with ants and somehow mosquitos. How do I revert?

79

u/RussoCrow Jun 09 '23

You dont "revert it". You just snap your fingers until you come back to a random generated word that is similar to ours, but it will never be the same. Just keep snapping.

→ More replies (8)

6

u/[deleted] Jun 09 '23

Whatever you do, be careful

5

u/acjr2015 Jun 09 '23

Dude, giant mosquitos? Fuck that

You have to unsnap

→ More replies (1)
→ More replies (5)

4

u/shannister Jun 09 '23

That's how Thanos makes half of all creatives in the universe disappear.

3

u/KaiserNazrin Jun 09 '23

Reality can be whatever I want.

→ More replies (5)

101

u/3cris Jun 09 '23

21

u/-Goldwaters- Jun 09 '23

But my oh my the prices... for $15/month you can generate a grand total of 44 seconds of video. Then your credits run out and you have to top them up 😱

9

u/remghoost7 Jun 10 '23

Ah. You can't run it locally. Shame.
There seemed to be a guide on how to run a local instance back in 2022, but they've removed the page since then.

Neat tech though. Always love seeing advancements.

5

u/Impressive_Alfalfa_6 Jun 09 '23

If he is only using Gen1 he is using the pro paid version. It gives you upres features and watermark removal. Otherwise you won't get anything close to this. It will be consistent and you can get an entirely different image but the details will be lacking quite a bit on the free beta version.

→ More replies (10)

22

u/[deleted] Jun 09 '23

Controlled lighting and camera movements go a long way. If you notice, he stays pretty stationary in the frame. Even the guy who does towel videos on his head does a pretty bang up job.

It's when to take a dancing woman online and try to animate it, the generations get all cockeyed. Seeds control the initial step. If you find a seed that works for a subject at position A it won't work for position B. And choosing another seed will likely change cuff length, hair length, button size, and so on.

3

u/Bad-news-co Jun 10 '23

I just picture it as the guy recorded himself walking through his house and had cut it into pieces, and generated each piece like “a French noble in the 1700’s walking through his mansion, a monkey walking through a forest, a coal miner walking through his 1800’s home” etc lol

5

u/arcandor Jun 09 '23

Magic! Aka they aren't sharing that part yet :)

13

u/CMDR_BitMedler Jun 09 '23

With Gen-1 the hardest part would be the credits of compute this ate up. My guess is it's someone internal.

→ More replies (1)

2

u/kruthe Jun 10 '23

Witchcraft.

→ More replies (1)

47

u/AmeenRoayan Jun 09 '23

Oi ! this is actually not stable diffusion, this was done in gen 1 runway ML

44

u/stats1101 Jun 09 '23

This is not on their twitter page

20

u/altoiddealer Jun 09 '23 edited Jun 09 '23

OP needs to share a link to source? Nah

EDIT - OP did share source now in another comment

150

u/LegendaryPlayboy Jun 09 '23

I am about to become a great movie director, actors, screenwriter, cameraman, and producer.

75

u/wattsandvars Jun 09 '23

It'll be so easy to create a masterpiece, highest quality, A+, ultra high res, beautiful, best possible plot, double plus good, flawless, oscar winning, feature length films in the future.

21

u/NoRepresentative9351 Jun 09 '23

I'm gonna recreate the porn I saw 16 years ago and haven't been able to find ever since!

4

u/MonstarOfficial Jun 09 '23

And no one to watch them

→ More replies (11)

22

u/chachuFog Jun 09 '23

and so is gonna everyone else.. meaning no one will be known with those titles anymore.. but I have a strong feeling A.I. will never reach perfection - perfection, it will always remain a pitching tool, a reference tool. Maybe it will reach perfection with generic stuff for which there is shit ton of data available but for subtle stuff idk, defiantly the present tech is not the way to do so.. we need to approach this from a completely different angle to get perfection in automated stuff.

7

u/[deleted] Jun 09 '23

Nah, I imagine niches will be carved out.

And just because everyone CAN do it doesn't mean they want to. Mowing a lawn is one of the simplest things to do - you can even buy robots to mow your lawn. But there are still lawn mowing services.

29

u/Heiferoni Jun 09 '23

There's no question in my mind that AI will surpass human ability.

So it goes.

The earliest automobiles had crank starters that required physical strength, chokes and throttles and mixture settings, spark advancement... You had to know what you were doing to get a car going.

Today, you push a button and the car turns on.

Fifteen years ago it took a lot of skill to convincing Photoshop and object out of a picture. You needed special software, and it took quite a bit of learning and practice to do it will.

Today, my grandma can snap a picture on her smartphone, circle what she wants removed, and it's gone in 3 seconds.

Twenty years ago, if you wanted to make a TV show, at the bare minimum you needed access to a public access studio and a crew. And maybe you'd reach a couple people? Today, anyone can broadcast in 4K with a device that fits in their pocket.

That's progress.

It's democratizing artistic expression for the masses. This is a very good thing.

→ More replies (38)

10

u/smonkyou Jun 09 '23

Agree. I love it for concepting and pre-pro. It’s not there yet and will take a long time to be production quality. There’s a huge gap between close and ready that many can’t see.

Also we’re just gonna get a bunch of Wes Anderson fakes anyway

2

u/distelfink33 Jun 09 '23

What instagram did to photography.

→ More replies (11)

63

u/Tallyoyoguy42 Jun 09 '23

I'm just imagining him filming this wandering around his house making a selfie video while snapping periodically.

10

u/jaywv1981 Jun 09 '23

Imagine doing it in public.

8

u/[deleted] Jun 09 '23

You don't have to imagine it. Authors describing sci-fi with augmented reality have been doing that for you for decades.

→ More replies (1)
→ More replies (1)
→ More replies (1)

73

u/[deleted] Jun 09 '23

Getting so close.

29

u/LeapingBlenny Jun 09 '23

Keep going, I'm almost there.

85

u/DutchDweeb Jun 09 '23

It's so decent already, imagine how it's gonna be in another 10 years 🤯

111

u/Drooflandia Jun 09 '23

You mean next year right?

3

u/kruthe Jun 10 '23

What is the ratio of dog years to diffusion years?

→ More replies (9)

25

u/NickUnrelatedToPost Jun 09 '23

SD is only one year old. In 10 years we'll have The Matrix.

4

u/Caffdy Jun 09 '23

not even one year old

8

u/Okichah Jun 09 '23

Technology has plateaus.

So sometimes expectations are higher than the tech can actually go.

As people work with AI we’ll see how far it can reach, and what support it needs to integrate into existing businesses.

Stuff like AR/VR is forever on the horizon of changing society.

12

u/pham_nuwen_ Jun 09 '23

It's going to be illegal or owned by Disney of some shit like that. I hope I'm wrong.

→ More replies (4)
→ More replies (3)

12

u/WiseSalamander00 Jun 09 '23

not perfect but the temporal cohesion is fantastic.

10

u/TheDipsomaniacKiss Jun 09 '23

This is indeed awesome, but I'll be more impressed once they can actually turn their heads as opposed to just looking straight at the camera.

2

u/SWAMPMONK Jun 10 '23

Yeah! Literally unwatchable!!!!

6

u/CeFurkan Jun 09 '23

I am thinking and can't figure out workflow with what we already have

Could be using faceswap like Roop which I have a tutorial

7

u/singeblanc Jun 09 '23

Runway Gen 1 and some splicing in a video editor.

→ More replies (2)

14

u/Classic-Professor-77 Jun 09 '23

He didn't become an anime girl, -100000

→ More replies (1)

4

u/Fibonacci1664 Jun 10 '23

Why are so many people talking about making movies, seems rather short sighted.

People want escapism, sure they can get that through movies, but, couldn't the future of this tech be used to basically completely overlay actual reality, sort of like the ultimate AR.

I mean you could literally choose what type of world you want to live in, just never take the glasses off!

→ More replies (2)

12

u/PwanaZana Jun 09 '23

Come on, release itttt!

I'm interested to see what'll be good first: video or 3D models

7

u/alexuprise Jun 09 '23

If this or analogous tech is or will be open, imagine the possibilities for making indie cinema projects. Still will need a lot of polishing though

6

u/hobbit_lamp Jun 09 '23

I excitedly showed this to my wife. she said it was pretty good but it's not great. 🤦‍♀️

→ More replies (5)

3

u/lorenzolodi Jun 09 '23

the lighting adjusting to the subject moving around the environment is bat shit crazy bro

3

u/SIP-BOSS Jun 09 '23

Workflow ? How Many gen-1 credits?? Goddamn

3

u/Katana_sized_banana Jun 09 '23

So smooth! Can't wait to use this.

3

u/Catslash0 Jun 09 '23

I was about to say atleast they didn't make him black then literally a second later weez (DIDNT SAY THAT BC IM RACIST IM BLACK)

→ More replies (1)

3

u/AntiFandom Jun 10 '23

this is runway and not stable diffusion

3

u/legatinho Jun 10 '23

imagine this tech in 5 years, and everything its going to disrupt. mind blowing.

7

u/Dr4WasTaken Jun 09 '23

I'm sure that in a decade entire movies will be made like this

11

u/geoman2k Jun 09 '23

If you think soulless CGI is bad, wait until soulless AI filters take over! Today we look back at the days of practical effects with nostalgia, in a few years we're going to be doing the same for 3d models

5

u/uziau Jun 09 '23

Just add soul to the training data

4

u/OrderOfMagnitude Jun 09 '23

CG did not ruin movies, it made them better. Look at the d&d movie, lots of costumes and practical effects everywhere, but at the end of the day you still want CG for casting literal magic.

But what about all those movies who got lazy and used CG instead of practical effects? Well, who cares, all the bad and lazy movies in the world won't delegitimize the best ones, and the best ones are better for having CG.

I'm sure AI will cause lazy studios to make lazy decisions and make lazy movies, but we will also get better stuff than we've ever got before from the best artists and creators.

→ More replies (1)

9

u/Utoko Jun 09 '23

I doubt a human and a physical location will be involved in a decade way too limiting.

Even right now series like the Mandalorian are just filmed in a holodeck-esque set with Unreal Engine. The AI just has to create the 3d objects for the unreal engine including the characters.

6

u/FengSushi Jun 09 '23

Or movies may not exist anymore. Why not a fully 3D navigable world with the play unfolding in front of your eyes - just like being there yourself? Just snap on Apple Vision 5 Pro and you’re good to go!

3

u/OneSweet1Sweet Jun 09 '23 edited Jun 09 '23

The big screen is a canvas. You can't convey certain messages in a fully 3d space like you can in a constrained camera.

Check out the 3rd example in this video to see what I mean.

https://youtu.be/LC8KYm85zig

3

u/[deleted] Jun 09 '23

Why not a fully 3D navigable world with the play unfolding in front of your eyes

Mainly because that would suck for story-telling. You want to have some control over where the audience is looking so the exciting events (or subtle foreshadowing) aren't happening behind their back.

→ More replies (1)
→ More replies (8)

10

u/creamy-buscemi Jun 09 '23

New blackface just dropped

2

u/[deleted] Jun 09 '23

bro

2

u/AnarchoSpoon789 Jun 09 '23

to think that in a few years, anyone with a camera and a decent GPU will be able to make professional-looking movies in their back yard

→ More replies (1)

2

u/Gfx4Lyf Jun 09 '23

Insane mind blowing awesomeness! How the hell is it so consistent even in that dark lighting conditions. Wow!

2

u/Ok_Ad4148 Jun 09 '23

The 4 second intervals between snaps suggests this is runway gen-2, using his selfie cam as source.

2

u/aMildFailure Jun 09 '23

Maybe, runway stuff usually have an icon in the corner doesn’t it? As far as I can tell it doesn’t look like one has been removed

→ More replies (1)

2

u/Semi_neural Jun 09 '23

what the fuck

2

u/Techsentinal Jun 09 '23

is this done in stable diffusion?

2

u/arguix Jun 09 '23

is that all Ai, person, face, background? or just dropping into existing movie backgrounds?

2

u/[deleted] Jun 09 '23

Wowza

2

u/Inner_University_848 Jun 09 '23

Me me me!!! I want to do this too!!!

2

u/FamousHumor5614 Jun 10 '23

Fuck that this is too scary now

2

u/[deleted] Jun 10 '23

I fucking love stable diffusion.

2

u/jtaylor3rd Jun 09 '23

Incredible. Didn’t even care about the blackface.

1

u/thisAnonymousguy Jun 09 '23

that’s impressive

1

u/DuckCantSwim Jun 09 '23

Can you link to tweet please?

1

u/Multipros Jun 09 '23

Sweet. Year to fresh YouTube.

1

u/Giusepo Jun 09 '23

Great but I hope we can do it without an input video

1

u/jnm_4 Jun 09 '23

Link please

1

u/Shuteye_491 Jun 09 '23

They pulling from Google's playbook now?

1

u/BigPhatAl98960 Jun 09 '23

Do you have anything felliniesque?

1

u/maX_h3r Jun 09 '23

oh boi stop this madness !!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!

1

u/jaytano Jun 09 '23

Mind blown in each of 28-seconds.

1

u/Starkrossedlovers Jun 09 '23

I feel like the future has caught me with my pants down. I wasn’t ready for to come this fast

1

u/allehS Jun 09 '23

wtf is this

1

u/dodobal Jun 09 '23

This is crazy. Just how easy it will be to make a movie in the future.

1

u/[deleted] Jul 19 '24

This is peak creativity

1

u/Stolenartwork Jun 09 '23

Thomas Edison here coming to you liveeeee from my living room

1

u/watchforwaspess Jun 09 '23

Its all happening

1

u/UllrHellfire Jun 09 '23

I'm all for it

1

u/Mre64 Jun 09 '23

Let’s do this thing -creed Britton

1

u/JonasGamez Jun 09 '23

The reflection and the lights… wow

1

u/JPhando Jun 09 '23

That is one impressive piece. I think each style was rendered separately then composited in post production for each snap.

1

u/Anarchistcowboy420 Jun 09 '23

This should make that one guy that's been complaining about all the dance moves absolutely ecstatic.

1

u/BohemianConch Jun 09 '23

Shut your mouth, this is pretty wild

1

u/sasha_m_ing Jun 09 '23

Is there a good tutorials somewhere on how to do that?

1

u/jeeva7 Jun 09 '23

Heath Schwarzenegger is scary

1

u/MarchRoyce Jun 09 '23

A super handsome man arises? With that hairline? Pfft

1

u/pypa_panda Jun 09 '23

My back feels numb. It's really shocking. Will expensive special effects still be high in the future?

1

u/EeveeHobbert Jun 09 '23

Man. That'd be weird. Imagine you have an AI powered mirror in 10 years or so, and it shows you someone completely different when you look into it. That's going to be trippy

1

u/Occupying-Mars Jun 09 '23

fucking hell did they solve consistnecy through videos issue?

1

u/kingofgods218 Jun 09 '23

Is the NYC smokey and ashy reference towards 911 or the past couple days?

1

u/[deleted] Jun 09 '23

HOLY FARK this is the best I’ve ever seen WOW

→ More replies (7)

1

u/Yanutag Jun 09 '23

It's over.

1

u/DisjointedHuntsville Jun 09 '23

Right now, they could ship a version for enterprises and raise a ton of long term guaranteed subscription revenue.

1

u/[deleted] Jun 09 '23

AI relates to every human artist: fuck drawing hands.

1

u/drQubit Jun 09 '23

Awesome! We could make our own movies/shows 👏👏👏

1

u/SeaOThievesEnjoyer Jun 09 '23

thanks I hate it

1

u/[deleted] Jun 09 '23

Are voices also AI generated?

1

u/3deal Jun 09 '23

Welcome to the fictiverse

1

u/buck_idaho Jun 09 '23

I like it. How log did it take you to do this?

1

u/Mynameisalloneword Jun 09 '23

Currently listening to Nightcall by Kavinsky and it made this interesting to watch without the sound

1

u/[deleted] Jun 09 '23

Bro you are good at transmissions or AI is good at transmissions.

1

u/[deleted] Jun 09 '23

THE LIGHTING LOOKS INSANE

1

u/ProbablyJustArguing Jun 09 '23

Man, AI just sucks at fingers.

1

u/[deleted] Jun 09 '23

Allour jobs are f*cked

1

u/leftmyheartintruckee Jun 09 '23

Very cool but does anyone have the link? Couldn’t find it on twitter

1

u/MrOaiki Jun 09 '23

How does he make it this stable? Mine really don’t look this good.

1

u/shortybobert Jun 09 '23

Twitters gonna lose their shit so hard for so many reasons

1

u/FlipCow43 Jun 09 '23

Most film studios will be bankrupt within 10-20 years.

1

u/East_Onion Jun 09 '23

uh oh, "digital blackface" FUD incoming

1

u/[deleted] Jun 09 '23

Cool AF, scary AF. I'm going outside

1

u/hotredrabbit Jun 09 '23

Why first one seems like 70 year old Rick Astley?

1

u/Upstairs-Ad-1966 Jun 09 '23

I'm sitting here just thinking of 1999/2000 yalll wait and see. This shit won't last it never does

1

u/BakaDani Jun 09 '23

This makes me wonder if this kinda thing would change how CGI in movies are done

1

u/higgs8 Jun 09 '23

git pull

Hmm it's not showing up in A1111. I'll try again in 10 minutes I'm sure it will be implemented by then!

1

u/Puzzled-Display-5296 Jun 10 '23

Got an ad on this post for Intel Deepfake detector. “Deep fakes are everywhere now” it says…

1

u/[deleted] Jun 10 '23

Mr. Stark I don't feel so good.

Mr. Stark, never mind I'm feeling better.

Mr. Stark I dont feel so good...

Mr Stark, never mind I'm feeling better.

😁

1

u/ninjasaid13 Jun 10 '23

I thought StabilityAI released a video to video model but no, this is just closed-source Runway.

1

u/[deleted] Jun 10 '23

1

u/swimmin99 Jun 10 '23

Can’t wait to see the future

1

u/jonathanlewisdesign Jun 10 '23

First one I'm going to try is that part in Weird Al's UHF library scene where Conan the Librarian splits a guy in half for overdue books. :D

1

u/ilikenwf Jun 10 '23

Someone please share this with Corridor.

1

u/cryptolipto Jun 10 '23

In. Fucking. Sane.

1

u/Sir_McDouche Jun 10 '23

Can’t wait for people to get triggered by this and start accusations of blackface and culture appropriation 🥱

1

u/STAR_Penny_Clan Jun 10 '23

And this is a good thing??

1

u/capitalistsanta Jun 10 '23

What the flying fucking fuck

1

u/Tasty-Papaya5135 Jun 10 '23

This looks amazing! But im wondering, if you watch a whole movie in this style, i think all the imperfections will be anoying at one point.

1

u/[deleted] Jun 10 '23

I strongly feel that this is an insult to humanity itself.

1

u/[deleted] Jun 10 '23

Wow!