论文检索

输入标题、作者或关键词,从 7,537 篇学术成果中精准定位

会议来源 全部会议

机器学习与综合 AI

自然语言处理

计算机视觉

数据挖掘与 Web

多媒体与图形学

未选择时检索全部会议
支持跨会议组合检索,PDF 均跳转至官方来源
7,537篇论文匹配“Interpretability”
第 3 / 377 页

Shingo Higashiguchi, Koki Kawabata, Yasuko Matsubara, Yasushi Sakurai

With the rapid development of web services, large amounts of time series data are generated and accumulated across various domains such as finance, healthcare, and online platforms. As such data often co-evolves with multiple variables interacting with each other, estimating the time-varying dependencies between variables (i.e., the dynamic network structure) has become crucial for accurate modeling. However, real-world data is often represented as tensor time series with multiple modes, resulting in large, entangled networks that are hard to interpret and computationally intensive to estimate. In this paper, we propose Kronecker Time-Varying Graphical Lasso (KTVGL), a method designed for modeling tensor time series. Our approach estimates mode-specific dynamic networks in a Kronecker product form, thereby avoiding overly complex entangled structures and producing interpretable modeling results. Moreover, the partitioned network structure prevents the exponential growth of computational time with data dimension. In addition, our method can be extended to stream algorithms, making the computational time independent of the sequence length. Experiments on synthetic data show that the proposed method achieves higher edge estimation accuracy than existing methods while requiring less computation time. To further demonstrate its practical value, we also present a case study using real-world data. Our source code and datasets are available at https://github.com/Higashiguchi-Shingo/KTVGL.

Liyao Li, Hao Chen 0081, Jiaming Tian, Wentao Ye, Lirong Gao, Chao Ye 0002, Ningtao Wang, Xing Fu, Yu Cheng 0005, Haobo Wang 0001 等

While Large Language Models (LLMs) excel at many reasoning tasks, their native inability to produce calibrated, multi-class probability distributions limits their use in high-stakes Web applications like content moderation and fraud detection. Existing methods to elicit probabilities from LLMs either sacrifice their crucial Chain-of-Thought (CoT) reasoning capabilities or suffer from poor calibration. To address this, we introduce a new paradigm, Verbalized Probability Distribution, and a novel training framework, RLVP (Reinforcement Learning with Verbalized Probabilities). RLVP fine-tunes an LLM to generate both an interpretable CoT and a complete, verbalized probability distribution. We overcome the ''insufficient reward granularity'' problem in standard Reinforcement Learning (RL) for classification by using soft probabilities from expert tabular models as a dense reward curriculum. Through large-scale joint training on 169 tabular tasks, we demonstrate that a single RLVP-trained model can surpass a strong, task-specific XGBoost baseline on up to 55% of tasks. More importantly, the trained model achieves state-of-the-art few-shot performance on unseen, heterogeneous Web benchmarks that mix structured data with free text, achieving performance comparable to or superior than expert models trained on the same limited data. This showcases a strong capability for generalization and knowledge transfer to complex Web data. Our work presents a viable path toward building general-purpose, probabilistically-sound, and interpretable foundation models for the Web.

Rui Wang 0043, Ziang Li, Haiping Huang, Jialin Yu 0001, Yuxiang Zhou, Guozi Sun

Existing multi-label topic models face several challenges when interpreting texts annotated with multiple labels: (1) they often associate irrelevant text segments with incorrect labels, which negatively impacts both segment and label interpretation; (2) they fail to effectively capture the semantic relationships between tokens and labels within the segment; (3) they do not integrate contextualized knowledge that could improve interpretability. To overcome these issues, we introduce the Contextualized Prompting Topic Model (CPTM). CPTM utilizes Chain-of-Thought (CoT) prompting to better align text segments with their semantically relevant labels. Furthermore, it integrates label-specific token visualization and topic mining procedure to facilitate the interpretation of tokens and labels. Experimental evaluations conducted on three multi-label text datasets show that CPTM significantly outperforms existing models in both segment and label interpretation. Human assessments also verify CPTM's effectiveness in accurately identifying label-relevant tokens within segments and providing insightful token-level interpretation.

Yuanzhen Hao, Desheng Wu

Identifying central claims from long documents is a fundamental yet challenging task in automated fact-checking pipelines. Manual extraction at the document level is costly and requires domain expertise, while existing automatic methods for claim extraction and evaluation tend to overlook critical dimensions that human fact-checkers consider essential for determining claim quality. In this paper, we propose a novel Human Value-Aligned framework that enables zero-shot document-level claim extraction and evaluation by aligning with expert preferences. We first elicit a structured set of Human Value Alignment (HVA) dimensions from expert annotations and incorporate them into prompt design, instructing large language models (LLMs) to extract high-quality claims that align with expert values. To assess the quality of extracted claims, we further introduce an LLM-based automatic evaluator that scores claims across HVA dimensions and quantifies alignment with expert-written claims. Furthermore, we propose a multi-level agreement metric to evaluate the reliability of automatic HVA evaluator. Experiment results show that our method significantly improves central claim extraction performance, achieving state-of-the-art chrF and P@N scores. Moreover, the proposed HVA evaluator achieves high agreement with human judgments and offers interpretable dimension-level assessments of extracted claims. The HVA framework establishes a reliable and scalable way for human-aligned document-level claim extraction and evaluation in real-world scenarios.

Zhaodan Zhang, Jin Zhang 0029, Jiafeng Guo

Zero-shot stance detection (ZSSD) aims to classify stances towards previously unseen targets without direct supervision on those topics during training. While recent approaches have explored various strategies, they often suffer from limited linguistic diversity or unstable semantic representations, restricting generalization to new domains. To address these challenges, we propose DPSD , a dynamic framework that integrates LLM-assisted data augmentation, multi-granularity feature fusion with contrastive learning, and adaptive prototype updating. Our method enriches the training data with both diverse targets and stylistically varied texts. A gate-controlled fusion mechanism combines deep contextualized features from BERT with shallow lexical patterns via TF-IDF, while contrastive learning refines the feature space by pulling similar instances closer and pushing dissimilar ones apart, thereby improving representation discriminability. Furthermore, we introduce a sliding-window prototype pool that dynamically maintains class-specific prototypes while preserving historical knowledge, ensuring stable and interpretable inference over time. We also incorporate LLM-calibrated semantic similarity as an auxiliary scorer for controlled reasoning. Experimental results on three benchmark datasets -SEM16, P-Stance, and VAST - show that DPSD achieves strong performance in various zero-shot settings, especially in cross-dataset and unseen target scenarios.

Jiping Zhang, Hua Zhu, Hong Huang 0001, Yongkang Zhou, Kehan Yin, Bang Liu 0003

Event sequences are integral to domains such as e-commerce, social networks, and healthcare. Traditional point process models, like Poisson and Hawkes processes, are foundational but limited by rigid parametric assumptions, constraining their flexibility in complex real-world scenarios. Neural point processes offer a more adaptable alternative, but typically perform implicit sequence modeling, which does not fully exploit critical event interaction patterns and limits transparency. To address these challenges, we introduce the Explicit Interaction-aware Attention Network (EIAN), a novel model that enhances event modeling by explicitly capturing both intra-type and cross-type event interactions. Specifically, EIAN employs two key components: an intra-type temporal encoder that preserves the unique temporal dynamics within each event type, and a cross-type interaction decoder that highlights interactions across event types. Furthermore, two temporal encoding mechanisms are integrated into the interaction decoder to handle irregular inter-event intervals in diverse temporal scenarios. Extensive experiments show that EIAN consistently outperforms existing models in predictive performance and provides deeper insights into event interaction patterns, advancing both flexibility and interpretability. Our code is available at https://github.com/CGCL-codes/EIAN.git.

Miaomiao Cai 0001, Zhijie Zhang, Junfeng Fang, Zhiyong Cheng 0001, Xiang Wang 0010, Meng Wang 0001

Multi-behavior recommendation faces a critical challenge in practice: auxiliary behaviors (e.g., clicks and carts) are often noisy, weakly correlated, or semantically misaligned with the target behavior (e.g., purchase), which leads to biased preference learning and suboptimal performance. While existing methods attempt to fuse these heterogeneous signals, they inherently lack a principled mechanism to ensure robustness against such behavioral inconsistency. In this work, we propose Robust Multi-Behavior Recommendation towards Target Behaviors (RMBRec), a robust multi-behavior recommendation framework grounded in an information-theoretic robustness principle. We interpret robustness as a joint process of maximizing predictive information while minimizing its variance across heterogeneous behavioral environments. Under this perspective, the Representation Robustness Module (RRM) enhances local semantic consistency by maximizing the mutual information between users' auxiliary and target representations, whereas the Optimization Robustness Module (ORM) enforces global stability by minimizing the variance of predictive risks across behaviors, which serves as an efficient approximation to invariant risk minimization. This local–global collaboration bridges representation purification and optimization invariance in a theoretically coherent manner. Extensive experiments on three real-world datasets demonstrate that RMBRec not only outperforms state-of-the-art methods in accuracy but also maintains remarkable stability under various noise perturbations. For reproducibility, our code is available at https://github.com/miaomiao-cai2/RMBRec/.

Weilin Zhou, Hao Zhang, Guangxin Wu

User interest is not static but rather a continuously evolving process shaped by diverse interactions across multimodal web platforms. Traditional recommendation systems often model user preferences as discrete snapshots or oversimplified trajectories, failing to capture the nuanced dynamics of interest evolution. In this work, we propose Drifting with Intent, a novel framework that formalizes user interest as a continuous-time stochastic process governed by spatio-temporal coupled stochastic differential equations (SDEs). Our approach fundamentally departs from diffusion-based methods by modeling interest evolution as a directed drift toward meaningful content rather than random diffusion. The core innovation lies in a multi-granularity hypergraph encoder that captures cross-scale user-item interactions, coupled with a unified SDE solver that generates personalized interest trajectories across temporal and relational dimensions. Unlike prior work employing redundant twin networks, we introduce a generative-discriminative co-optimization framework that efficiently balances content generation and recommendation precision within a single parameter space. Extensive experiments across eight diverse datasets demonstrate that our framework not only outperforms state-of-the-art methods in recommendation quality but also provides interpretable interest trajectories that reveal how user preferences evolve across different modalities and time scales. Our work bridges the gap between generative modeling and practical recommendation systems by treating user interest as a purposeful drift rather than a random walk.

Qihang Yu, Kairui Fu, Zheqi Lv, Shengyu Zhang 0001, Xinhui Wu, Chen Lin 0001, Feng Wei, Bo Zheng 0007, Fei Wu 0001

Recent advances in large language models (LLMs) have enabled more semantic-aware recommendations through natural language generation. Existing LLM for recommendation (LLM4Rec) methods mostly operate in a System 1-like manner, relying on superficial features to match similar items based on click history, rather than reasoning through deeper behavioral logic. This often leads to superficial and erroneous recommendations. Inspired by this, we propose ThinkRec, a thinking-based framework that shifts LLM4Rec from an intuitive system to a rational system. First, ThinkRec introduces a thinking activation mechanism by injecting synthetic reasoning traces, making the recommendation process resemble the Chain of Thought (CoT) reasoning of LLMs. This mechanism analyzes interaction histories, identifies user preferences, and makes decisions based on target items. Furthermore, considering the highly diverse distribution of recommendation data, we propose an instance-wise expert fusion mechanism to reduce the reasoning difficulty. By dynamically assigning weights to expert models based on users' latent features, ThinkRec adapts its reasoning path to individual users, thereby enhancing precision and personalization. Extensive experiments on various real-world web user behavior preference datasets demonstrate that ThinkRec significantly outperforms baselines in terms of recommendation accuracy and interpretability, providing superior recommendations based on a deeper understanding of user intent and a more rigorous reasoning process. Code is available in https://github.com/Yu-Qi-hang/ThinkRec.

Xusen Guo, Mingxing Peng, Xixuan Hao, Xingchen Zou, Qiongyan Wang, Sijie Ruan, Yuxuan Liang 0002

Web-based participatory urban sensing has emerged as a vital approach for modern urban management by leveraging mobile individuals as distributed sensors. However, existing urban sensing systems struggle with limited generalization across diverse urban scenarios and poor interpretability in decision-making. In this work, we introduce AgentSense, a hybrid, training-free framework that integrates large language models (LLMs) into participatory urban sensing through a multi-agent refinement system. AgentSense initially employs a classical planner to generate baseline solutions and then iteratively refines them to adapt sensing task assignments to dynamic urban conditions and heterogeneous worker preferences, while producing natural language explanations that enhance transparency and trust. Extensive experiments across two large-scale mobility datasets and seven types of dynamic disturbances demonstrate that AgentSense offers distinct advantages in adaptivity and explainability over traditional methods. Furthermore, compared to single-agent LLM baselines, our approach outperforms in both performance and robustness, while delivering more reasonable and transparent explanations. These results position AgentSense as a significant advancement towards deploying adaptive and explainable urban sensing systems on the web.

Ji Shen, Lixing Chen, Yang Bai 0010, Zhongqi Miao, Zhe Qu, Pan Zhou 0001, Jianhua Li 0001

Cross-view geo-localization (CVGL) establishes correspondences between ground-level and satellite images of the same geographic location, serving as a fundamental technology for smart city applications, including autonomous navigation, urban planning, and location-based services. Current CVGL approaches fall into two categories: feature-based methods achieve superior performance through 2D representation learning but lack interpretability. Spatial-based methods provide geometric understanding and interpretable matching but suffer from limited spatial modeling and weak cross-view alignment, leading to lower performance. We reformulate CVGL from a spatial perspective and propose an auxiliary task-enhanced network. The network captures spatial semantics and provides explicit alignment processes with visualizable results. We introduce an auxiliary spatial semantic alignment (SSA) task that learns spatial structure via vision foundation models (VFM) and BEV transformation to enhance the primary CVGL task. The primary task captures visual semantics, including texture and appearance. Within this unified framework with shared encoders, the primary task enriches the learned embeddings by fusing spatial structure with visual semantics, yielding spatially complete representations. Extensive experiments on three standard CVGL benchmarks demonstrate that our method significantly surpasses previous spatial-based approaches while maintaining competitive performance with state-of-the-art (SOTA) feature-based methods, achieving 98.48% R@1 on CVUSA and 71.05% R@1 on CVACT\_test. We provide comprehensive analyses through pixel-level activation maps and feature-space UMAP visualizations to validate both effectiveness and interpretability.

Yue Jiang 0005, Chenxi Liu 0003, Yile Chen 0001, Qin Chao, Shuai Liu 0018, Cheng Long 0001, Gao Cong

The World Wide Web increasingly relies on intelligent services that require accurate time series forecasting, from urban mobility platforms to adaptive web-based decision systems. In practice, building effective forecasting models typically requires abundant high-quality data, which may not always be available in all cities due to sensing limitations or data sparsity. To address this challenge, transfer learning methods aim to transfer knowledge from data-rich source cities to data-scarce target cities. However, source and target data distributions are often not identical: while some patterns from source cities may be beneficial, others can be irrelevant or even misleading. Existing transfer learning methods generally train the target model using all available source data without explicitly distinguishing between useful and non-useful knowledge, which may hinder performance. In this work, we propose xRAG4TS, a novel framework that integrates Retrieval-Augmented Generation (RAG) with Large Language Models (LLMs) for cross-city time series forecasting. xRAG4TS introduces a Cross-City Selective Retriever Module that filters semantically relevant historical patterns and documents from data-rich source cities, and incorporates them as structured prompts in an LLM Inference Module to guide forecasting in data-scarce target cities. By enabling selective, interpretable, and context-aware knowledge transfer, our method enhances robustness and scalability in web-oriented spatio-temporal applications. Extensive experiments on real-world cross-city datasets demonstrate that xRAG4TS significantly outperforms state-of-the-art baselines, highlighting its potential for powering adaptive and trustworthy web services under severe data scarcity.

Sahil Tripathi, Gautam Siddharth Kashyap, Mehwish Nasim, Jian Yang 0001, Jiechao Gao, Usman Naseem

Meme-based social abuse detection is challenging because harmful intent often relies on implicit cultural symbolism and subtle cross-modal incongruence. Prior approaches, from fusion-based methods to in-context learning with Large Vision-Language Models (LVLMs), have made progress but remain limited by three factors: i) cultural blindness (missing symbolic context), ii) boundary ambiguity (satire vs. abuse confusion), and iii) lack of interpretability (opaque model reasoning). We introduce CROSS-ALIGN+, a three-stage framework that systematically addresses these limitations: (1) Stage I mitigates cultural blindness by enriching multimodal representations with structured knowledge from ConceptNet, Wikidata, and Hatebase; (2) Stage II reduces boundary ambiguity through parameter-efficient LoRA adapters that sharpen decision boundaries; and (3) Stage III enhances interpretability by generating cascaded explanations. Extensive experiments on five benchmarks and eight LVLMs demonstrate that CROSS-ALIGN+ consistently outperforms state-of-the-art methods, achieving up to 17% relative F1 improvement while providing interpretable justifications for each decision.

Zhejian Yang, Songwei Zhao, Zilin Zhao, Hechang Chen

Link prediction is a cornerstone of the Web ecosystem, powering applications from recommendation and search to knowledge graph completion and collaboration forecasting. However, large-scale networks present unique challenges: they contain hundreds of thousands of nodes and edges with heterogeneous and overlapping community structures that evolve over time. Existing approaches face notable limitations: traditional graph neural networks struggle to capture global structural dependencies, while recent graph transformers achieve strong performance but incur quadratic complexity and lack interpretable latent structure. We propose TGSBM (Transformer-Guided Stochastic Block Model), a framework that integrates the principled generative structure of Overlapping Stochastic Block Models with the representational power of sparse Graph Transformers. TGSBM comprises three main components: (i) expander-augmented sparse attention that enables near-linear complexity and efficient global mixing, (ii) a neural variational encoder that infers structured posteriors over community memberships and strengths, and (iii) a neural edge decoder that reconstructs links via OSBM's generative process, preserving interpretability. Experiments across diverse benchmarks demonstrate competitive performance (mean rank 1.6 under HeaRT protocol), superior scalability (up to 6× faster training), and interpretable community structures. These results position TGSBM as a practical approach that strikes a balance between accuracy, efficiency, and transparency for large-scale link prediction.

Yulong Li 0002, Zhixiang Lu, Peixin Guo, Simin Lai, Yuxuan Zhang, Haochen Xue, Xiwei Liu, Yichen Li 0006, Zhaodong Wu, Feilong Tang 等

Opinion propagation research primarily focuses on phenomenon prediction rather than mechanism understanding, lacking interpretable frameworks to reveal underlying propagation dynamics. This limitation stems from two sources: existing methods employ end-to-end paradigms where parameters lack physical meanings, while available datasets suffer from incomplete hierarchical structures, coarse sentiment annotations, and limited domain coverage. To address these limitations, we introduce VISTA, a multi-dimensional opinion propagation dataset providing complete hierarchical structures, fine-grained emotional annotations, and cross-domain coverage. Based on this dataset, we propose an interpretable modeling framework integrating high-dimensional Hawkes processes with graph neural networks, enabling parametric expression of propagation mechanisms through event space constructed from emotional and reply level combinations. Through interpretable parameter analysis, we reveal three mechanistic patterns: differential emotional propagation strength, asymmetric hierarchical excitation, and temporal memory effects. Our framework establishes quantitative foundations for understanding opinion propagation dynamics, achieving best performance in sentiment prediction and structural consistency tasks while providing the first benchmark for multi-dimensional propagation mechanism analysis.

Mingjie Qiu, Zhiyi Tan 0002, Bing-Kun Bao

Rare social events are infrequent yet influential incidents. Predicting such events is practically significant yet inherently challenging due to their extreme scarcity in web-based event stream. Existing studies view this task as an imbalanced classification problem and adopt static rebalancing methods to mitigate scarcity. However, they (1) ignore inter-event dependency that represents the interactions between different event streams, failing to capture precursors that lead to rare events and fundamentally limits performance. They (2) overlook intra-event dependency between different time points within single event stream, which prevents the model from adapting to shifting event patterns and degrades its generalization ability. To this end, we propose a novel Mediator Learning (ML) framework, which introduces mediators to explicitly model complex dependencies within web-based event streams. Specifically, we propose (1) Precursor Event Router (PER) that utilizes an information-theoretic routing approach to extract precursor events as mediators from massive event streams. Based on extracted mediators, (2) Conditional Hierarchical Graph Network (CHG) is introduced to model observed events, mediators and rare events into bottom-up graph levels, where its upper-level propagation is conditioned on bottom-level probability distribution. Jointly, these two modules decompose the imbalanced task into two more balanced stages, which not only mitigates the scarcity of rare events but also explicitly model inter-event dependencies, so as to capture precursor events leading to target rare events. Finally, we design (3) Adaptive Information Regularizer (AIR) to optimize the two stages. It dynamically adjusts the information flow between two stages, which models intra-event dependencies and facilitate adaption to drifting event patterns. We theoretically reveal the effectiveness of ML by framing it within Information Bottleneck (IB) principle. Extensive experiments show our superior accuracy and interpretability compared with SOTA.

Mingjie Qiu, Zhiyi Tan 0002, Bing-Kun Bao

Social event prediction has garnered increasing attention in web-centered society. Most existing studies represent web-based event stream as chronological graph sequences, then leverage RNNs and GNNs to model temporal and relational patterns. However, this paradigm is inherently flawed: (1) RNNs struggle to capture long-term temporal dependencies, ignoring those temporally distant but influential events. (2) Spatio-temporal GNNs exhibit high computational complexity on large-scale real-time event streams, which hinders their web applications. To this end, we explore a novel paradigm called Fourier Graph Learning from the perspective of frequency domain. Specifically, we first define a novel data structure called Fourier Graph (FG). In FG, both nodes and edges are complex vectors, with real part encoding semantics and imaginary part representing semantic-specific temporal patterns. These temporal patterns are obtained by semantic-aware frequency filter, which utilizes semantics as guidance to adaptively incorporates both long-term dependency and short-term dynamic. Based on FG, we further propose Fourier Graph Neural Network (FGNN). It replaces time-domain convolution with frequency-domain multiplication for efficient aggregation. FGNN also includes a complex-valued event decoder, which fully leverages semantics and temporal patterns from complex space to predict future event probabilities. Extensive experiments show our superior performance with higher accuracy, less complexity and better interpretability compared with baselines.

Qin Zhang, Jiaying Liu 0006, Qian Tao, Zhiwei Guo 0004, Qiyue Zhong, Yifan Zhang, Ziyan Huang

Multimodal fake information increasingly threatens the Web ecosystem's trustworthiness and security, making improving detection accuracy a critical scientific challenge. The limited information interaction in traditional multimodal fake news detection methods fails to leverage semantic knowledge to model complex cross-modal forgery patterns and global structural anomalies, restricting the model's capability. To address the issues, this paper proposes a multimodal fake news detection method, SVPF-Net, that centers on semantic-driven visual enhancement and knowledge-aided modality-priority fusion. For visual representation optimization, we design a dual-feature extraction module and a dual-fusion enhancement module. A weighted fusion strategy is employed to construct a structured visual representation that integrates the semantics of local forgeries and global anomalies. Meanwhile, a cross-attention mechanism enables bidirectional alignment and interactive coupling between local and global image features, thereby achieving effective complementarity between local forgery cues and global anomaly patterns. For multimodal fusion, high-quality textual semantic features and visual representations are integrated via a modality-priority progressive fusion strategy that relies on cross-attention. The integration enables robust cross-modal semantic interaction and effectively enhances the efficiency of multimodal feature fusion. Comprehensive experiments validate the optimal performance of SVPF-Net and its ability to enhance interpretable semantics, providing valuable support for the practical application of reliable fake news detection.

Dongyuan Li, Ying Zhang 0065, Yaozu Wu, Renhe Jiang

Dynamic graph clustering aims to detect and track time-varying clusters in dynamic graphs, revealing how complex real-world systems evolve over time. However, existing methods are predominantly black-box models. They lack interpretability in their clustering decisions and fail to provide semantic explanations of why clusters form or how they evolve, severely limiting their use in safety-critical domains such as healthcare or transportation. To address these limitations, we propose an end-to-end interpretable framework that maps continuous graph embeddings into discrete semantic concepts through learnable prototypes. Specifically, we first decompose node representations into orthogonal role and clustering subspaces, so that nodes with similar roles (e.g., hubs, bridges) but different cluster affiliations can be properly distinguished. We then introduce five node role prototypes (Leader, Contributor, Wanderer, Connector, Newcomer) in the role subspace as semantic anchors, transforming continuous embeddings into discrete concepts to facilitate LLM understanding of node roles within communities. Finally, we design a hierarchical LLM reasoning mechanism to generate both clustering results and natural language explanations, while providing consistency feedback as weak supervision to refine node representations. Experimental results on four synthetic and six real-world benchmarks demonstrate the effectiveness, interpretability, and robustness of DyG-RoLLM. Code is available at https: //github.com/Clearloveyuan/DyG-RoLLM.

Lihui Liu, Jiayuan Ding, Subhabrata Mukherjee, Carl Yang 0001

Large Language Models have achieved impressive performance across a wide range of applications. However, they often suffer from hallucinations in knowledge-intensive domains due to their reliance on static pretraining corpora. To address this limitation, Retrieval-Augmented Generation (RAG) enhances LLMs by incorporating external knowledge sources during inference. Among these sources, Textural Graphs offer structured and semantically rich information that supports more precise and interpretable reasoning. This has led to growing interest in Graph-based RAG systems. Despite their potential, most existing approaches rely on a single retriever to identify relevant subgraphs, which limits their ability to capture the diverse aspects of complex queries. Moreover, these systems often struggle to accurately judge the relevance of retrieved content, making them prone to distraction by irrelevant noise. To address these challenges, in this paper, we propose MixRAG, a Mixture-of-Experts Graph-RAG framework that introduces multiple specialized graph retrievers and a dynamic routing controller to better handle diverse query intents. Each retriever is trained to focus on a specific aspect of graph semantics, such as entities, relations, or subgraph topology. A Mixture-of-Experts module adaptively selects and fuses relevant retrievers based on the input query. To reduce noise in the retrieved information, we introduce a query-aware GraphEncoder that carefully analyzes relationships within the retrieved subgraphs, helping to highlight the most relevant parts while down-weighting unnecessary noise. Empirical results show that our method achieves state-of-the-art performance and consistently outperforms various baselines. The code can be found from https://github.com/lihuiliullh/MixRAG