UniERF: A Uniform Embedding-based Retrieval Framework for E-commerce Search

摘要

E-commerce has become an integral part of daily life, and the ability to effectively retrieve items relevant to a user's query is crucial for enhancing the shopping experience. Embedding-based retrieval (EBR) has proven to be an effective approach in industrial e-commerce search systems. This method involves training models to generate high-quality representations of queries and items, followed by the use of efficient approximate nearest neighbor (ANN) search techniques to find relevant items. However, current EBR methods face several critical limitations: (1) multiple EBR branches often retrieve overlapping or redundant result sets; (2) allocation and utilization of computational resources remain suboptimal, hindering performance; (3) the differentiation modeling of features is somewhat neglected, which restricts the system's ability to retrieve diverse and representative results. These issues hinder the retrieval performance of online search systems. In this paper, we introduce a novel e-commerce search framework called the Uniform Embedding-based Retrieval Framework (UniERF). This framework is meticulously designed to incorporate diverse samples for joint model training, enabling the model to effectively leverage both the semantic information of queries and the personalized features of different users. Extensive offline and online experiments demonstrate that UniERF surpasses baseline methods across various evaluation metrics. UniERF has been successfully implemented in the existing retrieval system at JD.COM, a renowned online shopping website.