MMRad-22K: A Structured Multimodal Evidence Dataset for Chest X-ray Report Generation

Read full text
Authors: Yichen Zhao, Zelin Peng, Piao Yang, Piao Yang, Yu Huang, Wei Shen
Cited by: 0

Abstract

Chest X-ray (CXR) reporting follows a region-based clinical workflow in which radiologists inspect anatomical regions and integrate localized findings into a final report. However, existing resources for CXR report generation provide these supervision signals in fragmented forms. We introduce MMRad-22K, a dataset that organizes regional textual observations, anatomical grounding coordinates, localized image evidence, and report targets into structured multimodal evidence units for CXR report generation. To motivate this formulation, we first compare different evidence formats for report generation and find that structured multimodal evidence is generally more useful than text-only or bounding box-based evidence. We then adapt a unified LVLM backbone using MMRad-22K and show that adaptation with multimodal evidence outperforms both textual-evidence adaptation and end-to-end adaptation on language and clinically oriented metrics. Under the same evaluation protocol, the adapted model also reaches a performance level comparable to several open-source LVLM references. Together, these results support MMRad-22K as a practical structured multimodal resource for training and evaluating CXR report generation aligned with clinical reading workflows.

Fields of Study & Subjects

Multimodal Machine Learning Applications Artificial Intelligence in Healthcare and Education COVID-19 diagnosis using AI

Publication details

Journal / source
arXiv (Cornell University)
Publication date
13 February 2026
Language
EN
Document type
Preprint