QueryGaussian: Scalable and Training-Free Open-Vocabulary 3D Instance Retrieval
Quick Answer
QueryGaussian introduces a training-free framework for scalable open-vocabulary 3D instance retrieval, achieving over 70% GPU memory reduction and 180x faster inference.
Quick Take
This method leverages pre-trained 2D models for semantic interpretation, enabling efficient retrieval in city-scale environments with millions of instances.
Key Points
- QueryGaussian reduces GPU memory usage by over 70% compared to existing methods.
- Achieves 180x faster inference times, making it suitable for real-time applications.
- Utilizes pre-trained 2D vision models for effective semantic understanding.
- Decouples semantic understanding from geometric representation for improved efficiency.
- Enables retrieval in city-scale scenes with tens of millions of instances.
Paper Resources
Source Excerpt
Efficiently retrieving specific 3D instances from large-scale scenes via natural language prompts remains a formidable challenge in multimedia analysis. Existing approaches predominantly follow a "scene-level embedding" paradigm, which requires distilling high-dimensional semantic features into every 3D primitive. This strategy suffers from a fundamental architectural bottleneck: memory and computational costs scale linearly with scene complexity, inevitably triggering out-of-memory (OOM) failur
Want this in your inbox every morning?
Daily brief at your local 8am — bilingual EN/中文, free.
More from arXiv cs.CV
See more →ProMoE-FL: Prototype-conditioned Mixture of Experts for Multimodal Federated Learning with Missing Modalities
ProMoE-FL introduces a Prototype-conditioned Mixture-of-Experts framework for multimodal federated learning, effectively addressing missing modalities. It outperforms existing methods on four chest X-ray datasets, demonstrating superior feature synthesis capabilities in both homogeneous and heterogeneous settings.
