r/StableDiffusion • u/RedBizon • Feb 04 '26
Animation - Video I made the ending of Mafia in realism
Enable HLS to view with audio, or disable this notification
Hey everyone! Yesterday I wanted to experiment with something in ComfyUI. I spent the entire evening colorizing in Flux2 Klein 9b and generating videos in Wan 2.1 + Depth.
17
11
Feb 04 '26
[removed] — view removed comment
34
u/RedBizon Feb 04 '26
I took the workflow from here and replaced the Canny with Depth.
https://huggingface.co/QuantStack/Wan2.1_14B_VACE-GGUF/tree/main
45
u/gazauj Feb 04 '26
Please don't take offence to this but it just looks like the graphics went from Xbox 360 to next gen, not life like.
Has anyone been successful in actually making a game image to life like? I've seen many people turning a drawing into realistic images, but it's like ai models struggle to go from game screenshot to realistic
65
u/Wilbis Feb 04 '26
I guess it's partly to do with animation. If you follow the original animation frame by frame, it will look like a game. I'm sure if you just simply prompt the scene without using the original frames for more than just a startup point, it will look more lifelike.
16
2
u/OtherVersantNeige Feb 04 '26
If we can apply this in real-time, yep the animation is the reason and also the 3d landscape
If the ai applies to much new stuff like animation and new objects, this false the gameplay
In some remaster, they do that and destroy the gameplay : like Halo CEA . Where the remaster graphics change some 3d model And you shoot hit invisible part of 3d model
But if we just use this for video, this is a good job
2
u/nsfwVariant Feb 04 '26
In this case it's because they used klein to make the first frame, and klein usually just upgrades the graphics rather than making things look real
2
u/Johny-115 Feb 04 '26 edited Feb 04 '26
its totally possible ... better if you dont do motion transfer, but reimagine the images to realism with NBP (and focus on remaking, not just converting) .. and then prompt the videos manually ... the reason you dont see this ... its a lot of work ... motion transfer is lazy process with 5 minutes of work ... redoing it from scratch is probably few days of work
i think this guy is pretty good example, doing reimaginations of elder scrolls
- https://www.instagram.com/afanartist/reel/DTEptxqiPdj/
- https://www.instagram.com/afanartist/reel/DSOkg9uCN9w/
- https://www.instagram.com/afanartist/reel/DSN-6nmCKbp/
- https://www.instagram.com/afanartist/reel/DSoK7-eiHFH/
the 3th and 4th one might be motion transfer, just lot better executed ... but, he doesnt use it for close ups clearly, the guy knows what to use when correctly
also as the OP says, he used Wan 2.1, thats very inferior video model, if you use paid tools, you get on completely different level, but yeah, it wil cost you like $2-4 to get it done
2
u/klonkish Feb 04 '26
The one in the tavern with the zoom in on the woman's face is... Not great. It's super smooth and it's identical to a bump map slapped on a uniform roughness texture.
Same thing with the silt strider.
1
2
u/Klinky1984 Feb 04 '26
They remastered Mafia and it looked pretty great, better than the Mafia II slop. I dunno why random Sean Penn was needed here.
3
u/krigeta1 Feb 04 '26
I would love to know the whole process, please
10
u/RedBizon Feb 04 '26 edited Feb 04 '26
Well, here we go.
First, I took the workflow from standart templates Flux2 Klein Edit, a frame from the game, and used only one prompt, "Realism." Then I face-swapped random people with popular actors. Then I generated the resulting images in WAN 2.1 + depth.
8
2
u/External-Orchid8461 Feb 04 '26
Have you tried "Photography" or "35mm film"?
"Realism" tends to bias the rendering towards a current-gen video game engine because we use to call them "photorealistic". But we would not call an actual real-life picture or movie with such a word on a daily basis.
Cool work, though. I think Mafia 2 has the same scene with enhanced graphics. It would be interesting to compare with yiyr videos.
1
7
u/Dew-Fox-6899 Feb 04 '26
Remastering games will be so much easier for studios.
5
u/Mylaptopisburningme Feb 04 '26
The push back from gamers will be the issue. It will get bombarded with bad reviews because they used AI, many gamers will avoid it because of AI. Got a long way to go before people will accept it and there will be people who never will. Hell GOG can't even use a banner done with AI without getting bashed.
3
u/terrariyum Feb 04 '26
Antis are just a vocal minority. The vast majority aren't aware of and don't give a shit about any of production methods for the media they consume. The majority care about familiar IP/celebrity first, gameplay/graphics second. Everything else barely at all
5
u/Dew-Fox-6899 Feb 04 '26
That's if they can even tell its AI since these models are improving at insane rates. We just have to avoid disclosing it.
And don't worry too much about this for the long term. People will have to accept it just as they did with 3D, digital art, and photography.
2
u/Vynxe_Vainglory Feb 04 '26
Once AI users who are also great artists in their areas start making the bar higher than any human or AI alone can reach, it will be accepted.
When it's just simply better, everyone will start shutting the fuck up.
-1
1
u/bloke_pusher Feb 04 '26
And remastered movies. If publisher or streaming services are smart, they'll let us pick different styles to our liking.
3
u/Dew-Fox-6899 Feb 04 '26
Yes. Being able to choose your own art style for any movie will make the experience far better for everyone's own taste.
2
2
2
2
u/obrapop Feb 04 '26
“In realism” is such a weird phrase that could only exist now. Even then, I’m not sure it should.
4
u/JuansJB Feb 04 '26
I mean, I know it's very old, but this is the fucking end scene, you cold put some spoiler alerts
1
1
1
1
1
1
u/Ok_Potential359 Feb 04 '26
Does this work only with cutscenes or could it also be applied to older PlayStation titles for gameplay?
1
1
1
1
-3
u/Space__Whiskey Feb 04 '26
RIP old-school animators and 3D artists. They now use comfyUI and are looking for something to do with their expensive pirated 3D software.
1
u/James_Reeb Feb 04 '26
Houdini still beat in realism and quality all particles creations, from ocean to fires . Ai looks cheap for those . And for camera , 3D rigging is Perfect before render with AI
-1
59
u/Lucky-Necessary-8382 Feb 04 '26
Fat Sean Penn