About this paper
L3G-World uses a compact latent 3D Gaussian memory and alternating autoregressive updates with a video diffusion transformer to generate spatially consistent interactive worlds in real time.
Interactive world models generate visual content conditioned on user actions, yet maintaining spatial consistency over long-horizon exploration in real time remains challenging. Existing approaches rely on either temporal context or explicit 3D memory, both of which scale poorly because memory grows with the length of the generated stream. Moreover, explicit 3D memories condition latent video generators by re-encoding RGB renderings, which precludes real-time generation. In this paper, we introduce a Latent 3D Gaussian Memory (L3G) that combines the efficiency of feed-forward reconstruction with a compact, rapidly renderable scene representation. Building on this memory, we propose…
Latent 3D Gaussian MemoryL3G-World3D GaussianVAE latent featurevideo diffusion transformerDiTautoregressivespatial consistency
- Upvotes
- 7
- Authors
- 8
- Published
- Oct 29, 2026
Summary and abstract excerpt via Hugging Face Papers ↗ · arXiv.
Trending history
L3G-World: Real-Time Infinite World Generation with Latent 3D Gaussian Memory was first seen on Hugging Face · Daily papers on Oct 30, 2026. Since then it has appeared in 14 checks on 2 different days. Its best position was #5 of 30, reached on Oct 30, 17:28 UTC. It is #7 right now, holding steady at #7 over the last 6 checks.