Prior-Constrained Relevant Feature driven Image Fusion with Hybrid Feature via Mode Decomposition

摘要

Infrared and visible image fusion (IVIF) aims to extract fine details from visible images and complementary information from infrared images. Most existing methods directly extract relevant and complementary features from each modality using neural networks, often overlooking the guidance process and the distinct frequency-domain characteristics of these features. To address this, we propose HRFusion-a novel frequency-domain framework that extracts complementary features from hybrid features using prior-constrained relevant features, effectively enhancing complementary information and reducing redundancy. In HRFusion, hybrid and relevant features are robustly extracted to guide the subsequent fusion stage. By leveraging frequency differences between complementary and relevant features, we introduce the Enhanced Complementary Frequency Network (ECFNet), which uses optimized Variational Mode Decomposition (VMD) to effectively separate and process these signals for fusion. The overall architecture is built with the proposed DTBlock, which captures both global and local features. Extensive experiments show that our method achieves state-of-the-art performance on the TNO, MSRS, M3FD, and Harvard Brain datasets, outperforming recent approaches. Code is available at https://github.com/liuuuuu777/HRFusion.