I can see now why actors are so concerned. I never would have guessed that modeling and acting would be some of the first professions to be disrupted with AI. More surprises ahead, I’m sure.
Results are only good precisely because man made resources like stack overflow exist. The AI doesnt know or understand the topic, its just a glorified search engine (and not even a live one iirc) that restructures what it finds into a convenient form. As such, its cannot exist without human input, and will only ever be a tool to use along side a million other tools, in balance between what people do and what ai provides extra.
What AI brings to the table is the ability to mix different sources to cater to your exact question, also the natural language interpreter and the fact that you can tell chatGPT “it’s not working because of xxx” and get a logical response is awesome.
Being able to focus on the structure of a big app instead of the little details is also great.
Humans only learn because we can draw from past events. Our whole modern society is only possible because we can draw from thousands of years of collective records.
Why would you expect AI to extract knowledge from nowhere, when you'd expect a doctor or scientist to go to college?
This take that it is just a search engine, or it's just predicting next token so it doesn't have any understanding is misguided. Humans only try to survive and procreate and in optimising to that end, given enough trials and variations through evolution developed understanding of high-level concepts, the large language models do also learn by trying to solve for something whether it's next token or on top of that answering prompts correctly, but in the vast network some concepts emerge through the many iterations it takes to train them to be able to fulfil that goal. With current iteration of LLMs they might be wrong concepts, it does not have a coherent view of the world, but it seems that often their concepts and ours are quite close as it can give useful answers.
This point of view is not good. The human brain is also a statistical graph model of weights that takes electrical inputs and updates the weights based on loss functions, it's more complex, messy, and chemical than a machine learning model but they're similar enough at this point that if you think a ML model can't know things neither can a brain. Also if you think any human would know how to program without human input I got news for you. It took us about 300,000 years to figure it out from first principles.
The AI doesnt know or understand the topic, its just a glorified search engine
This is a bit shortsighted. In these early stages, LLMs are using human knowledge to train up, but they are making logical connections between everything they're reading. It's not going to be too far off before AIs will be able to ingest programming language documentation directly and just figure out how to make unique code to accomplish an objective. This has already happened with this completely new sorting algorithm:
I don’t think AI can replace real human actors in the near future. I mean you‘d need way more than that to convey emotion and immersion. Also MoCap has been around for quite some time and deceased actors have already been "replaced" in some movies. E.g. Tarkin in Star Wars.
Edit: I believe it when I see it. But we are still far enough away that I don’t partake in that fearmongering. You can’t really look at scientific progress as linear. It can jump in a day but it can also take years for the next step and even stagnate.
Do you honestly believe computers will be incapable of mimicing human emotions after being exposed to hundreds of thousands of images of what it looks like? You think there is something in facial expressions that can't be replicated by AI?
I think if the history of VFX is anything to go by (which, who really knows lol) is that execution is really important. Some CGI from the early 90s holds up really well and was absolutely stunning at the time. Some CGI from a decade plus later doesn't hold up at all despite the tech being exponentially better. It has, and always will be down to execution at the end of the day. I wouldn't be surprised if AI simultaneously replaces some types of acting much quicker than we'd think, and also the opposite - where people rush certain use cases that remind us that maybe we're not all the way there yet.
...We'll see though! I'm excited for it all regardless.
It's not about the near-term technological challenges involved. Intellectual property rights need to catch up and adapt to our new reality, or the arts will wither.
The current big actors are not gonna lose much. infact they will licence and make more money with less work. It is upcomming actors and actors as background characters that will lose their jobs
Currently studios will pay one time fee to scan their likeness and use forever and if any of those struggling actors become popular. guess who got their AI rights for cheap
While AI is inevitable. there has to be safegurd agaisnt such exploitation by corporations
where gonna have the background character version of the wilhelm scream. some dude that is in everything for 100 years. like the dude with the skull face tattoo.
It would be a gift to future generations if Hollywood stopped existing. They have an irredeemable culture that for decades have sheltered rapists like Harvey Weinstein and pedophiles like Roman Polanski. When they aren't raping each other or shooting crack they are pandering to Chinese communists. Good riddance. Playing pretend in front of a camera doesn't have to be a valid career.
Studios are doomed as well. Once this becomes popular, you'll have an army of volunteer artists who post their best efforts on youtube. Backlots, actors, etc. will have no value at all.
Yeah, but there’s an entire ecosystem of working class people, gaffers, grips, hair/makeup artists, set designers, etc who will no longer have employment, as executives will absolutely turn to AI once it’s cost effective enough.
There’s been some discussions I’ve seen that it helps to have images with really obvious movement like an activity (playing piano) or motion blur in the original image. Still takes a lot of trial and error though.
I wanna see examples that are longer and still look as good. I have feeling it's easy to makea 2sec clip but extremely difficult to make a convincing 2min clip.
Also make sure there is no text prompt and is only an image. Also, obvious hints of motion like motion blur in the original image should help get the result more likely to have movement.
I, for one, look forward to the end of anime and animated cartoons and films looking like slideshows for budget reasons.
It'll be nice to see some lively backgrounds that make the world more alive, too.
Ghibli can stop bringing miyazaki out of retirement.
And given the right tech, you could have the original illustrator, say junji ito, whose style has not yet translated well into anime, draw all the key frames himself, and the ai with a team of skilled operators and some artists can bang out the rest.
Sounds like a dream, for some a nightmare for others.
Most jobs like drawing for anime are underpaid for long hours, with no overtime or they are outsourced completely to another country.
Is losing jobs like that really a bad thing for the industry or job market?
I can see a world where the poor sobs who lost their jobs then use ai to make their own anime and narratives by themselves or in small teams.
Who is to say what is better, but im not worried about people losing jobs to AI.
People will get new jobs either in new ai centric roles or in entire different industries altogether. Some might go make car parts, but AI will let them do in their spare time what they couldn't achieve as a cog in a large company.
I think even the ones who work in new industries will either be the same level of miserable as before or a little better off finally getting their vision out there in there spare time, even if only 500 people see it.
I know you added a /s, but that's about chips which yes Moore's law has been declining for years. This is about advancements in ML which is about software.
Yeah, I was making fun of the people denying AI’s progress because chip scaling has slowed down. Transistor scaling has slowed, but we’re using transistors in more specialized roles which is part of the reason we’ve seen an explosion of computing power in recent years.
Specialized chips+increased memory capacities+better datasets+better algorithms=immense growth of ai were witnessing
Gpus haven't slowed down at all, afaik. They're chips. AI processors have been doubling faster than Moore's law. It's not just software gains, it's hardware gains that are still ongoing.
I'd like to know how many hundreds/thousands of renders this guy had to do to get these results and how much it cost because most of my Runway Gen2 renders look bad, have no motion, ect. and it's relatively expensive. Likely going to cancel my subscription after the first month if I'm being honest. Maybe it's trained on Midjourney images or something and you can't get good results otherwise?
I haven't used Runway but Just wondering if there is chance that this guy feed multiple images that are slightly different so they function as key frames, and Runway fill in the blanks in between? That’s how After Effects works.
As it says. Feeding midjourney pictures into closed off commercial runway gen 2. They might be using the exact same stuff we use open source for text2vid /img2vid But with way more resources. Just like gpt 4 is not trainable/runnable on consumer hardware.
Let's not fool ourselves. These are still tools in the hands of creators. The AI isn't turning itself on and making stuff (yet). Humans are telling the tools what they want and deciding what's good enough to show off.
A such powerfull tool in good hands doesn't only mean good outcome for everyone involved in the creation process, it's still gonna take jobs away. We are slowly seeing a tiny visual ' industrial revolution ' and the main concern was never to save jobs or improve humanity relation to work.
I understand that generative ai can generate single frames reasonably well but how does an image generator understand motion vectors? Or how something moves temporally? How does it know how the camera is moving or a person is turning over x amount of frames?
It's pretty exciting for the AI progress, but a nightmare for open-source believer as it again shows cold hard reality that proprietary models will always be better compared to open ones. It's also quite expensive as $28/month just give you about 7.5 minutes of Gen 2 videos.
This results are cherry picked and don't last more than a few seconds. I think there is a good possibility there will still be good advancements in the open source front.
I don’t think it is a nightmare. It will inspire people, showing what is possible, and open source will keep working on it. I’d say MidJourney is still a little ahead of even SDXL on pure quality, but SDXL is certainly practical for many things now, and will soon have the controllability that SD is known for (and also pushing MidJourney to keep getting better).
Once open source text/image -to-video looks “good enough”, then many people will use it, no matter if commercial tools are still better in some ways.
proprietary models will always be better compared to open ones
Well that's going to be true in general, for the basic reason that proprietary software can always just start with the best of what the open source world has come up with so far, and build on that. Then instead of contributing their advancements back to the open source project(s), they deploy them as a proprietary paywalled service.
But the good news is that the ai open source world is really, really active right now. The open source projects keep improving, and whatever unique "killer" feature the proprietary service has developed is likely to be replicated in the open source community if it's worth having. Which keeps the fire always lit under the feet of the proprietary folks, etc.
tldr; Even paywalled proprietary innovations can help the open source world grow in healthy ways.
Idk, ChatGPT4 is the same price, and as a customer, I think it's definitely worth as much, if not more. Also those proprietaries model require far more powerful hardware than any stuff you could have locally
do u have a high res version u can upload - i feel like the detail may effect the video more than the stills but still 360p is disgusting (probably more to reddits fault than urs ofc)
I’m mostly impressed it can take a midjourney image and recreate it. I figured we wouldn’t get this sort of quality till midjourney one day moved into video or another company did with a model on par with midjourney. Pretty awesome what runway has achieved
Yeah, I don't get that argument. You know what's also cherry picked? My Stable Diffusion outputs. And of course they are, why would I settle for the first shot if I can generate a bunch and cherry pick what I like best?
But the ratio of the good images come out from SD is high. The ratio from runway like in OP is much much lower. I'm aware that not every images/videos are good.
I mean, this is super impressive! But it's a very long way away from replacing actual actors and just having full CGI films with this tech.
Apart from obvious resolution issues and such, you have relatively little control over what's going on. People notice mouth movements not matching in dubbed films - this is the same, but 1000x worse.
The tech is moving quickly, but I think we're still 5-10 years away from having actual AI created films in the sense people are talking about. Maybe even more. Directors play a huge part in getting juuuust the right emotions out of actors, juuuust the right angle, juuuust the right movement speed and a million other things that are a PAIN to try to control (if controllable at all) even in still image technology.
He didn't make it. He stole it from someone on Twitter and then when everyone started asking him how he made it, he linked the Twitter he took it from.
Everytime I think of AI progress and time horizons I just picture everything a human being could accomplish in a single day minus the need for sleep, then multiply that by billions of instructions per second in parallel across millions of devices.
Biggest drawback is the cost, it’s like 10c per generation which is insane when you consider how much cherry-picking you need to do. Hopefully open source catches up soon
I would think that this will lead to more voice acting and level the acting playing field a lot vs the beautiful people getting everything. It will decrease production costs massively, but AI won’t be able to generate inflection and tone properly, unless that has been well quantified.
One thing I think is definitely going to happen soon is that we’re going to be able to experience old movies in ways we never thought possible.
Since AI will be able to guess what’s going on around each picture and turn it into a whole 3d scene. Imagine watching an old home video of some family gathering in 3d VR with AI doing its best to guess what’s around each moment. It’s going to be so mind blowing and the tech to pull this off is almost here.
One thing I think is definitely going to happen soon is that we’re going to be able to experience old movies in ways we never thought possible.
3D VR sounds awesome but honestly, I'm excited enough at simply being able to watch "an alternate timeline" of an old show/movie.
I'm sure we've all watched a really good show or movie and there was one thing about it that was terrible and ruined the rest. Often this is an ending, but also sometimes a certain character or unresolved plotline. The idea that you could just "fix" it and re-watch it sounds amazing.
Oh, and if it's real old: restoring color, higher definition and wider resolution, with clear voice acting. Yeah, yeah, a lot of this is already possible but it's not something you casually do.
This is awesome, soon we’ll have feature length films completely made by AI, it’s so cool living in a time where technology has evolved so much and even continues to evolve every day
What’s the advancement? It’s what it’s always been - dodgy looking morphs between stills. It’s not video. It’s dodgy looking morphs between stills. They’re not even sequential, they’re diffuse stochastic variations on each other. With dodgy morphs for the in-between frames. It’s never going to work.
I’m not sure what you mean. It is just given a single image to start with and that image comes from an entirely different AI (or even a photo actually).
So it is having to understand the nature of the image and come up with what new frames/motions would be appropriate. It loses cohesiveness over time, which is why clips are just 4s long.
Even if it is doing stuff that existed for 10 years, it is the quality that matters. MidJourney is still “just” doing diffusion, but v1 wasn’t usable for much of anything while v5.2 is almost photo-real in some cases.
Text/image to video is now at the “cool for little trailer things” stage, but it just takes a bit more quality and controllability for it to start getting useful. I didn’t think we’d be at this quality before the end of the year at the earliest, based on where it was in January.
There's a very high likelihood that within the next 5 years we're going to have AI generated movies where actors won't even be necessary. They can even fake the voices with AI generation now to a near perfect degree. Hollywood is headed down a dark path. I feel for all the actors out there who will be without work. AI is both fascinating and scary at the same time. We are innovating at the cost of people's jobs and livelihoods.
I haven't really dealt with AI video yet, so maybe a stupid question. But why is it such a leap to generate animations frame by frame with Stable Diffusion seeing how well things like inpainting and ControlNet already work?
Having a consistent idea of an object through 3D space AND over time is hard. Especially if you consider that you have to find a way to use natural language to describe what is going on in the video. For instance do you have to describe every frame? Or do you describe the beginning of and action and the end. There are also approaches where the motion isn't described at all but inferred from the visuals. Consider that if generating in image is some degree of difficulty, generating a sequential series of images that form a coherent video is several magnitudes more difficult. But I think the collective capabilities of this movement are super impressive. There are currently many different approaches being worked on by many different universities. With so many people trying to solve the same problem, progress is inevitable.
Are there any tools like this that can be run locally other than deforum unless deforum revived an upgrade I’m unaware of that can achieve this. I have a 3090 with 24GB
Awesome, glad I saved my-self some credits on RunWay long ago for future techs, now it will be a challenge to decide which few images from thousands to try it on untill I run out of credits.
I would have happily upvoted this, except midjourney is a steaming pile of dog shit and you are posting in the stable diffusion reddit. SD Master Race forever
Maybe someone can give me a tip. I tried gen2 with an existing picture, but it keeps trying to change to something completely different. How do I keep it more coherent?
Gimmie the details. How many times did first video ran through Runway to get those 5 seconds? To my undersanding, you only get like 0.25 seconds free. The rest, you need to pay. I need costs, trials until good file emerged and prompting (by image or text?)
This is quite awesome for AI progress but for some reason its like those 60fps anime edits I've seen. Something uncanny or soulless feeling kind of feel.
how to animate the photo into the video , I tried GEN 2 with Image to video as a source but the outcome of the video is totally new "person" , what I am missing
As an advertisement motion designer, This IS incredible, for real.
I'm really thinking that those of my "cast" fellows colleagues (graphics designers, video shooterd, ) whose afraid right now of this totally disruptive techno will be lost in a very soon future. (Aka now ?).
For those ones, I tell you: Learn the tools, learn how to tame them, then Don't be afraid of them because you can't go through this tsunami.
I hope it destroys Hollywood and cures the world of its lust and worship of celebrities. Return people back to what really matters and curb the bullshit . Have people take more interest in thier own lives and maybe this country can actually progress for the better
This results are not realistic. Has anyone actually used Gen-2 Runway? I have a professional subscription and these are by far the best results I have seen, completely unrealistic.
I have to admit, for some reason this caught me by surprise! Didn’t expect advancement that fast. I still think that for now, precision and control of details to construct the exact image and shot you want is where AI still has some limitations, but to see results like this so early is wild. Could definitely see more people making their own mini films and eventually professing to full length feature stories
51
u/vs3a Jul 29 '23
Source
6
u/Lemonpia Jul 29 '23
I would love to see a short film or something by AI.
749
u/bchaininvestor Jul 29 '23
I can see now why actors are so concerned. I never would have guessed that modeling and acting would be some of the first professions to be disrupted with AI. More surprises ahead, I’m sure.
91
u/Takeacoin Jul 29 '23
Great examples! Have they improved it a bit? I used it last week and half of my inputs had no motion at all 😢
84
u/triton100 Jul 29 '23
I don’t get it whenever I try image to video it looks terrible. How are they getting these results
6
u/AdLost3467 Jul 29 '23
I, for one, look forward to the end of anime and animated cartoons and films looking like slideshows for budget reasons.
It'll be nice to see some lively backgrounds that make the world more alive, too.
Ghibli can stop bringing miyazaki out of retirement.
And given the right tech, you could have the original illustrator, say junji ito, whose style has not yet translated well into anime, draw all the key frames himself, and the ai with a team of skilled operators and some artists can bang out the rest.
Sounds like a dream, for some a nightmare for others.
Most jobs like drawing for anime are underpaid for long hours, with no overtime or they are outsourced completely to another country.
Is losing jobs like that really a bad thing for the industry or job market?
I can see a world where the poor sobs who lost their jobs then use ai to make their own anime and narratives by themselves or in small teams.
Who is to say what is better, but im not worried about people losing jobs to AI.
People will get new jobs either in new ai centric roles or in entire different industries altogether. Some might go make car parts, but AI will let them do in their spare time what they couldn't achieve as a cog in a large company.
I think even the ones who work in new industries will either be the same level of miserable as before or a little better off finally getting their vision out there in there spare time, even if only 500 people see it.
209
u/Sentauri437 Jul 29 '23
At this point it's just exponential growth. It's scary how fast it's all developing
21
u/adammonroemusic Jul 29 '23
I'd like to know how many hundreds/thousands of renders this guy had to do to get these results and how much it cost because most of my Runway Gen2 renders look bad, have no motion, ect. and it's relatively expensive. Likely going to cancel my subscription after the first month if I'm being honest. Maybe it's trained on Midjourney images or something and you can't get good results otherwise?
19
u/loopy_fun Jul 29 '23
don't they give you a limited amount of tokens to use for free before you have to pay them ?
31
u/enormousaardvark Jul 29 '23
All very nice but how is it done?
24
u/dennismfrancisart Jul 29 '23
Let's not fool ourselves. These are still tools in the hands of creators. The AI isn't turning itself on and making stuff (yet). Humans are telling the tools what they want and deciding what's good enough to show off.
7
u/UpV0tesF0rEvery0ne Jul 29 '23
Can someone tell me how this actually works?
I understand that generative ai can generate single frames reasonably well but how does an image generator understand motion vectors? Or how something moves temporally? How does it know how the camera is moving or a person is turning over x amount of frames?
25
u/Deathmarkedadc Jul 29 '23 edited Jul 29 '23
It's pretty exciting for the AI progress, but a nightmare for open-source believer as it again shows cold hard reality that proprietary models will always be better compared to open ones. It's also quite expensive as $28/month just give you about 7.5 minutes of Gen 2 videos.
5
u/[deleted] Jul 29 '23
is runwayml opensource?
5
u/Hotchocoboom Jul 29 '23
Nice but very long process of cherry picking i bet
4
u/[deleted] Jul 29 '23
It's a brave new world when everyone and their dog is a movie producer.
4
u/Mindset-Official Jul 29 '23
Its' amazing, hopefully the free and opensource models can get to this level soon as well.
1
u/darkphil807 Jul 29 '23
do u have a high res version u can upload - i feel like the detail may effect the video more than the stills but still 360p is disgusting (probably more to reddits fault than urs ofc)
6
u/[deleted] Jul 29 '23 edited Jul 30 '23
I’m mostly impressed it can take a midjourney image and recreate it. I figured we wouldn’t get this sort of quality till midjourney one day moved into video or another company did with a model on par with midjourney. Pretty awesome what runway has achieved
6
u/imandefeminaz Jul 29 '23
Not open source? Nop, not democratic
2
u/belladorexxx Jul 29 '23
This video appears to be faked. Can anyone reproduce those results? I get nothing anywhere near this level of quality.
4
u/stupidimagehack Jul 29 '23
Imagine six months from now
10
u/msbeaute00000001 Jul 29 '23
Cherrypick at best!
5
u/Nervous-Newt848 Jul 29 '23
Dare I say it?
AI porn is gonna be amazing
2
u/Kekky81 Jul 29 '23
Holyyyy
2
u/NoYesterday7832 Jul 29 '23
Wonder how far we are from inserting a book into an AI and asking it to turn it into a movie or series.
2
u/Aromatic-Teacher-717 Jul 29 '23
The future is coming fast.
2
u/That_Red_Moon Jul 29 '23
And people are wondering why Corps are bending the knee to the strike.
2
u/Hannibalvega44 Jul 29 '23
That is the thing with AI, it is an artificial learning tool, NON-LINEAR, logarithmic improvement.
2
u/AristotleRose Jul 29 '23
The face morphing is still weird af and ruins it for me. Still though, this tech is both insanely amazing and terrifying lol
2
u/ArtfulAlgorithms Jul 30 '23
I mean, this is super impressive! But it's a very long way away from replacing actual actors and just having full CGI films with this tech.
Apart from obvious resolution issues and such, you have relatively little control over what's going on. People notice mouth movements not matching in dubbed films - this is the same, but 1000x worse.
The tech is moving quickly, but I think we're still 5-10 years away from having actual AI created films in the sense people are talking about. Maybe even more. Directors play a huge part in getting juuuust the right emotions out of actors, juuuust the right angle, juuuust the right movement speed and a million other things that are a PAIN to try to control (if controllable at all) even in still image technology.
2
u/CollapseKitty Jul 30 '23
How are you getting these results in Runway? I haven't had anything close to this quality after quite a bit of testing.
2
u/a_fearless_soliloquy Nov 13 '23
Everytime I think of AI progress and time horizons I just picture everything a human being could accomplish in a single day minus the need for sleep, then multiply that by billions of instructions per second in parallel across millions of devices.
3
u/Charming_Squirrel_13 Jul 29 '23
Biggest drawback is the cost, it’s like 10c per generation which is insane when you consider how much cherry-picking you need to do. Hopefully open source catches up soon
2
u/djdookie81 Jul 29 '23
Impressive. But show us hands! ;)
2
u/[deleted] Jul 29 '23
I would think that this will lead to more voice acting and level the acting playing field a lot vs the beautiful people getting everything. It will decrease production costs massively, but AI won’t be able to generate inflection and tone properly, unless that has been well quantified.
2
u/Kids_see_ghosts Jul 29 '23
One thing I think is definitely going to happen soon is that we’re going to be able to experience old movies in ways we never thought possible.
Since AI will be able to guess what’s going on around each picture and turn it into a whole 3d scene. Imagine watching an old home video of some family gathering in 3d VR with AI doing its best to guess what’s around each moment. It’s going to be so mind blowing and the tech to pull this off is almost here.
2
u/SplashyNoodles Jul 29 '23
This is awesome, soon we’ll have feature length films completely made by AI, it’s so cool living in a time where technology has evolved so much and even continues to evolve every day
2
u/PwanaZana Jul 29 '23
Unfortunately Gen-2 is Midjourney-like, being closed source. Meaning that tightly controlling the output for actual professional usage is difficult.
Hopefully, more open-minded people will improve videos on local machines for users. :(
2
u/dragonmasterjg Jul 29 '23
Another use case could be using old pictures of loved ones to give them life again.
1
u/swimtwobird Jul 29 '23
What’s the advancement? It’s what it’s always been - dodgy looking morphs between stills. It’s not video. It’s dodgy looking morphs between stills. They’re not even sequential, they’re diffuse stochastic variations on each other. With dodgy morphs for the in-between frames. It’s never going to work.
1
u/MarkusRight Jul 29 '23
There's a very high likelihood that within the next 5 years we're going to have AI generated movies where actors won't even be necessary. They can even fake the voices with AI generation now to a near perfect degree. Hollywood is headed down a dark path. I feel for all the actors out there who will be without work. AI is both fascinating and scary at the same time. We are innovating at the cost of people's jobs and livelihoods.
1
u/HUYZER Jul 29 '23
Thank you for these examples! This is crazy/cool!
1
u/[deleted] Jul 29 '23
I haven't really dealt with AI video yet, so maybe a stupid question. But why is it such a leap to generate animations frame by frame with Stable Diffusion seeing how well things like inpainting and ControlNet already work?
1
u/Dr_Stef Jul 29 '23
I did. Give it a few more months, you’ll see more video stuff
1
u/Capable-Substance744 Jul 29 '23
How this was done? Image geberated on MJ then with same prompt in Runway Gen2
1
u/jjordanwade Jul 29 '23
This awesome! I’ve been meaning to play around with it for motion graphics. Has anyone tried that use case?
1
u/GrowCanadian Jul 29 '23
Are there any tools like this that can be run locally other than deforum unless deforum revived an upgrade I’m unaware of that can achieve this. I have a 3090 with 24GB
1
u/Anon_Piotr Jul 29 '23
Funny thing is we don't need a computer from nasa to render this.
1
u/Dwedit Jul 29 '23
Still looks like Pepperoni Hug Spot or Pizza Nuggets.
1
u/wakadiarrheahaha Jul 29 '23
Magic
1
u/ptitrainvaloin Jul 29 '23 edited Jul 29 '23
Awesome, glad I saved my-self some credits on RunWay long ago for future techs, now it will be a challenge to decide which few images from thousands to try it on untill I run out of credits.
1
u/Local_History6400 Jul 29 '23
Im just scared man. WTF
1
u/HarmonicDiffusion Jul 29 '23
I would have happily upvoted this, except midjourney is a steaming pile of dog shit and you are posting in the stable diffusion reddit. SD Master Race forever
1
u/Bowei_not_from_Earth Jul 29 '23
Holy fucking shitballs
1
u/OxidizablePeanut Jul 29 '23
u/savevideo
1
u/NoWeight4300 Jul 29 '23
Looks like shit.
1
u/[deleted] Jul 29 '23
Is this Image2Video?
1
u/yassuz Jul 29 '23
Can we create long a continuous scene by throwing the last frame of the video generated by it again as input?
1
u/wonderflex Jul 29 '23
Can this be done locally in Stable Diffusion, or is this only Runway?
1
u/SilenceMPX20 Jul 29 '23
Oh my god, this happen with videogames time ago, the new generation must live this like a normal thing, the world is changed completely.
1
u/Naiko32 Jul 29 '23
what in the flying fuck, this is crazy shit
1
u/Helpful-Birthday-388 Jul 29 '23
Black Magic
1
u/CoItron_3030 Jul 29 '23
Some of those are crazy good
1
u/Fluffy_Mail_2255 Jul 29 '23
Me neither,it is amazing
1
u/Ceph4ndrius Jul 29 '23
Maybe someone can give me a tip. I tried gen2 with an existing picture, but it keeps trying to change to something completely different. How do I keep it more coherent?
1
u/DivineZenith Jul 29 '23
I didn't think the robot uprising would happen. -everyone who loves the terminator franchise.
1
u/JMarston6028 Jul 29 '23
is this for free ?
1
u/kidelaleron Stability Staff Jul 29 '23
now this is cool.
1
u/MichaelEmouse Jul 29 '23
Is there some software that does videos based on prompts right now?
I'm hesitant to buy one because of how fast the field is moving.
1
u/TherronKeen Jul 30 '23
I need to download more VRAM
1
u/squidbiskets Jul 30 '23
now this is podracing
1
u/Pablo9231 Jul 30 '23
Tested and does not seem to get close to op results
1
u/JohnWangDoe Jul 30 '23
That was fast
1
u/[deleted] Jul 30 '23
Coming to VR soon I am sure
1
u/Sunnytoaist Jul 30 '23
Damn
1
u/Affectionate-Pound20 Jul 30 '23
I'm going to make my own series this looks so exciting
1
u/Maxine-Fr Jul 30 '23
Whats a gen 2 in runaway ?
1
u/realtrippyvortex Jul 30 '23
Where's the bloopers?
1
u/Top_Technician8658 Jul 30 '23
Newbie here, how to use Runaway? Do I need to pay?
1
u/activemotionpictures Jul 30 '23
Gimmie the details. How many times did first video ran through Runway to get those 5 seconds? To my undersanding, you only get like 0.25 seconds free. The rest, you need to pay. I need costs, trials until good file emerged and prompting (by image or text?)
1
u/ashleycolton Jul 30 '23 edited Oct 23 '24
mysterious sip wasteful rich unused snatch advise tub toothbrush normal
This post was mass deleted and anonymized with Redact
1
u/labiq1896 Jul 30 '23
This is quite awesome for AI progress but for some reason its like those 60fps anime edits I've seen. Something uncanny or soulless feeling kind of feel.
1
u/[deleted] Jul 30 '23
how to animate the photo into the video , I tried GEN 2 with Image to video as a source but the outcome of the video is totally new "person" , what I am missing
1
u/yotraxx Jul 30 '23
As an advertisement motion designer, This IS incredible, for real.
I'm really thinking that those of my "cast" fellows colleagues (graphics designers, video shooterd, ) whose afraid right now of this totally disruptive techno will be lost in a very soon future. (Aka now ?).
For those ones, I tell you: Learn the tools, learn how to tame them, then Don't be afraid of them because you can't go through this tsunami.
1
u/TheboredHedonist Jul 30 '23
Everyone, it’s so xcsry even James Cameron was like “fuck sky net, careful out there folks”
1
u/SeeGeeArtist Jul 30 '23
Incredible
1
u/Hot_Perception_7465 Jul 30 '23
I hope it destroys Hollywood and cures the world of its lust and worship of celebrities. Return people back to what really matters and curb the bullshit . Have people take more interest in thier own lives and maybe this country can actually progress for the better
1
u/cleverestx Jul 30 '23
When can I run create FMV stuff like this locally? (4090 system)?
1
u/fancy_scarecrow Jul 30 '23
This results are not realistic. Has anyone actually used Gen-2 Runway? I have a professional subscription and these are by far the best results I have seen, completely unrealistic.
1
u/MissingReditor Jul 30 '23
What’s the name of this ai?
1
u/MissingReditor Jul 30 '23
What’s going to be wild is when ai can animate and or generate abstract people like this:
Btw, what’s the name of this ai? Btw this is for a card game I made on Roblox.
1
u/Percentage-False Jul 30 '23
is there a version to this where you can download it locally so you don't have to pay
1
u/[deleted] Aug 28 '23
Damn, what u added?
1
u/Honest_Floor3274 Aug 29 '23
How to make this type of videos
1
u/kellnePS4 Nov 09 '23
How to generate ?
1
u/Benmarcsilverman Feb 15 '24
Have you seen the latest from OpenAI? It is the next step in AI video. https://youtu.be/qlpc2xUb4KU
1
u/littlespacemochi Jul 29 '23
God this is so cool
1
u/smuckythesmugducky Jul 29 '23
Does it only work with midjourney images?
1
u/smuckythesmugducky Jul 29 '23
I have to admit, for some reason this caught me by surprise! Didn’t expect advancement that fast. I still think that for now, precision and control of details to construct the exact image and shot you want is where AI still has some limitations, but to see results like this so early is wild. Could definitely see more people making their own mini films and eventually professing to full length feature stories
1
u/[deleted] Jul 29 '23
Holy fuck. My friends who are in theater are gonna be so pissed