VigilFormer: Deformable Attention for Video Anomaly Detection with Causal Risk Inference
Quick Answer
VigilFormer introduces a novel framework for video anomaly detection, utilizing Deformable Spatio-Temporal Attention and Causal Risk Inference.
Quick Take
It achieves AUC scores of 87.83%, 97.21%, and 89.74% on UCF-Crime, ShanghaiTech, and CUHK Avenue, respectively, while maintaining 41.5 FPS on a single GPU, outperforming recent methods in both accuracy and speed.
Key Points
- VigilFormer employs Deformable Spatio-Temporal Encoder to optimize attention across frames.
- Causal Anomaly Classifier uses dilated causal convolutions for snippet-level feature analysis.
- Adaptive Confidence Scheduler reduces computation by skipping low-information frames during inference.
- Achieves state-of-the-art AUC scores on multiple benchmarks while maintaining real-time performance.
- Outperforms recent weakly-supervised approaches in both speed and detection accuracy.
Paper Resources
Source Excerpt
arXiv:2606. 14724v1 Announce Type: new Abstract: Video anomaly detection in surveillance settings must balance detection accuracy against real-time throughput, a tension that existing methods address either through stronger feature extractors or more efficient architectures, but rarely both. We present VigilFormer, a unified framework that combines deformable spatio-temporal attention with causal temporal modeling to detect anomalies in untrimmed surveillance video. …
Want this in your inbox every morning?
Daily brief at your local 8am — bilingual EN/中文, free.
More from arXiv cs.CV
See more →ProMoE-FL: Prototype-conditioned Mixture of Experts for Multimodal Federated Learning with Missing Modalities
ProMoE-FL introduces a Prototype-conditioned Mixture-of-Experts framework for multimodal federated learning, effectively addressing missing modalities. It outperforms existing methods on four chest X-ray datasets, demonstrating superior feature synthesis capabilities in both homogeneous and heterogeneous settings.
