Predicting the Unseen: A Novel Dataset for Hidden Intention Localization in Pre-abnormal Analysis

摘要

Our paper introduces a novel video dataset specifically for Temporal Intention Localization (TIL), aimed at identifying hidden abnormal intention in densely populated and complex environments. Traditional Temporal Action Localization (TAL) frameworks, focusing on overt actions within constrained temporal intervals, often miss subtle pre-abnormal actions that unfold over extended periods. Our dataset comprises 228 videos with 5790 clips, each annotated to capture fine-grained actions within ambiguous temporal boundaries using the Joint-Linear-Assignment methodology. This approach enables detailed analysis of the evolution of abnormal intention over time. To detect subtle, hidden intention, we developed the Intention-Action Fusion module, an creative approach integrating dynamic feature fusion across 11 behavioral subcategories, significantly enhancing the model's ability to discern nuanced intention. This enhancement has led to performance improvements of up to 139% in specific scenarios, dramatically boosting the model's sensitivity and interpretability, crucial for advancing proactive surveillance systems. By pushing the boundaries of technology, our dataset and methodologies foster proactive surveillance systems capable of preemptively identifying potential threats from nuanced behavioral patterns, encouraging further exploration into the complexities of intention beyond observable actions. The dataset is available at https://github.com/Zzz99999/Hidden_Abnormal_Intention.