Closing the Loop: Training-Free Revisit Consistency for Autoregressive Generative Rendering
Quick Answer
The paper presents a training-free method for improving revisit consistency in autoregressive generative rendering, leveraging temporal and spatial correspondences from 3D engine outputs.
Quick Take
It outperforms existing baselines on TartanAir and TartanGround datasets, enhancing video quality without additional training. This approach addresses inconsistencies when the camera revisits locations, crucial for applications in gaming and immersive content.
Key Points
- Introduces a training-free method for autoregressive generative rendering.
- Utilizes temporal and spatial correspondences to enhance revisit consistency.
- Demonstrated on TartanAir and TartanGround datasets.
- Outperforms existing training-free baselines without sacrificing video quality.
- Addresses inconsistencies in long-horizon video generation.
Paper Resources
Source Excerpt
Recent conditional video generation models have shown promising potentials to transform 3D engine renderings, such as depth maps and untextured geometry, into photorealistic videos for gaming and immersive content creation. These applications require long-horizon auto-regressive generation that continuously synthesizes new frames while preserving a persistent 3D world. Auto-regressive generators synthesize video chunk by chunk with a bounded KV cache, so when the camera revisits a location after
Want this in your inbox every morning?
Daily brief at your local 8am — bilingual EN/中文, free.
More from arXiv cs.CV
See more →ProMoE-FL: Prototype-conditioned Mixture of Experts for Multimodal Federated Learning with Missing Modalities
ProMoE-FL introduces a Prototype-conditioned Mixture-of-Experts framework for multimodal federated learning, effectively addressing missing modalities. It outperforms existing methods on four chest X-ray datasets, demonstrating superior feature synthesis capabilities in both homogeneous and heterogeneous settings.