Agent Data Protocol: Unifying Datasets for Diverse, Effective Fine-tuning of LLM Agents
CMU · Amazon · Carnegie Mellon University · Ohio State University, Columbus · the University of Hong Kong, University of Hong Kong · University of Hong Kong · Shanghai Jiao Tong University · Fujitsu · School of Computer Science, Carnegie Mellon University · Facebook · All Hands AI · Ohio State University
PDF 由论文原始站点提供,PaperCompass 不保存论文文件。
摘要
Public research results on large-scale supervised finetuning of AI agents remain relatively rare, since the collection of agent training data presents unique challenges. In this work, we argue that the bottleneck is not a lack of underlying data sources, but that a large variety of data is fragmented across heterogeneous formats, tools, and interfaces. To this end, we introduce the Agent Data Protocol (ADP), a light-weight representation language that serves as an "interlingua" between agent datasets in diverse formats and unified agent training pipelines downstream. The design of ADP is expressive enough to capture a large variety of tasks, including API/tool use, browsing, coding, software engineering, and general agentic workflows, while remaining simple to parse and train on without engineering at a per-dataset level. In experiments, we unified a broad collection of 13 existing agent training datasets into ADP format, and converted the standardized ADP data into training-ready formats for multiple agent frameworks. We performed supervised finetuning on the unified data, and demonstrated an average performance gain of $\sim$20\% over corresponding base models, and delivers state-of-the-art or near-SOTA performance on standard coding, browsing, tool use, and research benchmarks, without domain-specific tuning. All code and data are released publicly, in the hope that ADP could help lower the barrier to standardized, scalable, and reproducible agent training.