U2-BENCH: Benchmarking Large Vision-Language Models on Ultrasound Understanding
University of Oxford · Beijing University of Aeronautics and Astronautics · Nanjing University · SUN YAT-SEN UNIVERSITY · Hong Kong Baptist University · Beihang unversity · The Insititute of Advanced Computing Technology, Beijing University of Aeronautics and Astronautics · National University of Singapore · Nanjing University of Aeronautics and Astronautics · University of Cambridge · Department of Computer Science and Engineering, The Chinese University of Hong Kong · The Chinese University of Hong Kong · Universität Mannheim · Haining Dolphin Voice Medical Technology Co., Ltd · Dolphin AI · Alibaba Group · Fudan University
PDF 由论文原始站点提供，PaperCompass 不保存论文文件。
摘要
Ultrasound is a widely-used imaging modality critical to global healthcare, yet its interpretation remains challenging due to its varying image quality on operators, noises, and anatomical structures. Although large vision-language models (LVLMs) have demonstrated impressive multimodal capabilities across natural and medical domains, their performance on ultrasound remains largely unexplored. We introduce U2-BENCH, the first comprehensive benchmark to evaluate LVLMs on ultrasound understanding across classification, detection, regression, and text generation tasks. U2-BENCH aggregates 7,241 cases spanning 15 anatomical regions and defines 8 clinically inspired tasks, such as diagnosis, view recognition, lesion localization, clinical value estimation, and report generation, across 50 ultrasound application scenarios. We evaluate 23 state-of-the-art LVLMs, both open- and closed-source, general-purpose and medical-specific. Our results reveal strong performance on image-level classification, but persistent challenges in spatial reasoning and clinical language generation. U2-BENCH establishes a rigorous and unified testbed to assess and accelerate LVLM research in the uniquely multimodal domain of medical ultrasound imaging.