A Two-Stage Full Fine-Tuning and LLM Post-processing Framework for MCABSA

摘要

In recent years, Multimodal Sentiment Analysis (MSA) has attracted growing attention for its ability to interpret human emotions by integrating information across multiple modalities. Multimodal Conversational Aspect-based Sentiment Analysis (MCABSA) extends this research frontier by incorporating multi-party conversational contexts and requiring comprehensive extraction of sentiment elements. MCABSA presents substantial challenges, including the need to understand complex conversational contexts, integrate heterogeneous multimodal signals, and identify causal reasoning at the cognitive level. To address these challenges, we propose a two-stage Full Fine-tuning and LLM Post-processing (FLP) framework. In the first stage, we develop a multimodal caption-enhanced full fine-tuning pipeline that performs structured extraction of sextuples and sentiment flip tuples. The second stage introduces paraphrase-based sextuple verification to identify and filter low-quality sextuples for Panoptic Sentiment Sextuple Extraction (Task-1), while implementing trigger classification with a distribution alignment mechanism to determine trigger types for sentiment flipping and enhance output consistency for Sentiment Flipping Analysis (Task-2). Comprehensive experiments on both MCABSA challenge subtasks demonstrate the effectiveness of our approach, achieving 1st place on Task-1 and 3rd place on Task-2.