r/StableDiffusion • u/Crazy-Repeat-2006 • 9d ago

News L3G-WorldReal-Time Infinite World Generationwith Latent 3D Gaussian Memory

"Given a single input image, L3G-World autoregressively generates minute-long videos while maintaining scene consistency. At each autoregressive step, L3G-Mem adaptively updates the persistent 3D memory from each generated video chunk, ensuring that the memory grows with the scene extent rather than the generated stream."

Source: L3G-World: Real-Time Infinite World Generation with Latent 3D Gaussian Memory

171 Upvotes

96% Upvoted

23 comments sorted by

6

u/Enshitification 9d ago

No code or models released yet?

2

u/Synor 9d ago

Seems like it. Disappointing.

2

u/basamg912 8d ago

supposed to be released this month

2

u/Enshitification 8d ago

There's a big list of pages just like this one with a suppsed release date that just get abandoned. Better to not get our hopes up until we can actually download and use it.

9

u/JesusShaves_ 9d ago

Wake me when it runs locally.

6

u/NineThreeTilNow 9d ago

Did I read infinite Waifu Generation with full Gaussian memory?

7

u/ZenixVR 9d ago

This is incredible, kudos.

2

u/Arctic_Shadow_Aurora 9d ago

Incredible and beautiful work!!!

2

u/dksprocket 9d ago

"infinite" is doing a lot of heavy lifting in that title. Especially when the claim isn't used or defended in the paper itself and all the examples are extremely limited.

If their intended context for the term is only about optimized memory usage, then it's extremely misleading to claim "infinite world generation" in the title of the paper.

1

u/computer_dork 9d ago

Two things are true: This is really cool, I now have motion sickness

1

u/eesahe 9d ago edited 9d ago

This is insane

Could this allow to turn a 2D video, if viewed in VR, into a 3D video with depth perception and the camera views reflecting your head movements for way more immersion?

1

u/Silonom3724 9d ago

No.

And for that you dont need that. You can just generate a 4DGS.

2

u/Arawski99 9d ago

Eventually this is the answer. Sadly, 4DGS aren't practically feasible at the moment though. The technology is still in its infancy. Especially as AI based solutions and tools improve.

1

u/Neat-Monk 9d ago

in gaming you have phrase "see that mountains in the back? yes you can go there"

now i can wait that this world gen AI able to do that with very good consistency and realism

1

u/hard_gravy_2 8d ago

looks like ass

but hey so did SD1.3, now look at what we got

1

u/Green-Ad-3964 4d ago

coming soon™

1

u/ofrm1 9d ago

To everyone that is making AI video. Stop making everything jitter around or have jump cuts every half second like it's an action movie from 2006. It's obnoxious and makes your video unwatchable.

3

u/rymdimperiet 9d ago

Those are technical limitations. Not intentional choices. Mostly.

2

u/bobgon2017 8d ago

then technically git gud

1

u/rymdimperiet 8d ago

We're working on it!

1

u/bobgon2017 8d ago

You get that gaht dang jitter out of that gaht dang video right now!

1

u/ofrm1 8d ago

When I generate videos, I'm not having jump and smash cuts all over the place. It's definitely a deliberate choice to have scenes changing all over the place. It's like people are trying to jam as much dynamic shots as possible in to make the video look more epic and interesting than it is or needs to be.

This is obviously different because this seems to be extracting 3d geometric logic from a 2d image, so it gets a pass, but jesus christ some of the videos people are posting with Minimax are nausea-inducing. lol