From Tasks to Teams: A Risk-First Evaluation Framework for Multi-Agent LLM Systems in Finance

摘要

Current financial benchmarks prioritize large language models (LLMs) for task accuracy and portfolio returns, yet overlook risks arising from multi-agent cooperation, tool-sharing, and real-world financial actions. We introduce M-SAEA, a Multi-agent, Safety-Aware Evaluation Agent that audits LLM teams without fine-tuning, deploying ten probes across four layers: model, workflow, interaction, and system, to yield a continuous risk vector and natural-language rationale. Evaluated across three high-stakes tasks (finance management, webshop automation, transactional services) with six prominent models, M-SAEA (i) identifies unsafe trajectories with minimal false positives, (ii) reveals latent risks (e.g., temporal staleness) that are not addressed by standard metrics, and (iii) provides granular, actionable scores for balancing safety and latency pre-deployment. By quantifying safety as a model-agnostic metric, M-SAEA reorients evaluation from individual tasks to collaborative teams, offering a robust template for risk-first assessment of agentic AI in finance and beyond.