HGACLLM: Attribute Completion in Heterogeneous Graph with Integration of External Knowledge from Large Language Models

摘要

Heterogeneous graphs (HGs) are graph topologies with multiple types of nodes and edges, which have attracted increasing attention in graph representation learning. Many heterogeneous graph neural networks (HGNNs) assume that the graph structure information is complete when processing heterogeneous graph data. However, due to factors such as privacy protection and high data acquisition costs, heterogeneous graphs often suffer from missing attributes. Existing methods that rely on local neighbor aggregation to obtain missing attributes have achieved good performance in various downstream tasks, yet when neighbor types differ from the target node type, the completed attributes become highly unreliable. Therefore, this paper proposes a novel method for Attribute Completion in Heterogeneous Graph with Integration of External Knowledge from Large Language Models (HGACLLM). HGACLLM simplifies local attribute aggregation while maintaining model performance, and is the first to leverage LLMs to learn external knowledge of nodes with missing attributes in the attribute completion task on HGs. First, HGACLLM uses a mean aggregator to precalculate neighbor attributes along different metapaths and applies a Transformer-based semantic fusion module to integrate node attributes from various metapaths, generating local attributes. Second, it infers implicit external knowledge of target nodes based on textual descriptions of attribute-rich neighbors along metapaths. Finally, HGACLLM combines local attributes and external knowledge to generate complete attribute representations. We evaluated our method on six real-world datasets, where HGACLLM achieved up to a 1.94% improvement in evaluation metrics for the downstream tasks. The experimental results demonstrate that HGACLLM achieves state-of-the-art performance.