Bridge: A Cross-Modal Learning Framework for Unified Semantic Representation in Noisy Communication

摘要

Multimodal semantic communication systems face a critical challenge in extracting and aligning semantic features across heterogeneous modalities within a unified representation space, particularly under noisy transmission conditions. To address this, we propose Bridge, a cross-modal learning framework that integrates video, audio, and text into a unified semantic space through feature disentanglement and contrastive alignment. Bridge separates modality-specific and modality-invariant representations, enhancing both intra-modal precision and inter-modal generalization. During decoding, it leverages heterogeneous foundation models to preserve semantic fidelity under channel noise. Extensive experiments on multiple multimodal benchmarks under varying SNR levels demonstrate that Bridge maintains high semantic consistency and reconstruction quality, improving image reconstruction by approximately 16.3% in low-SNR regimes. Our work provides a practical and theoretically grounded framework for next-generation multimodal semantic communication systems.