单位:[1]Infervis Med Technol Co Ltd, Beijing, Peoples R China[2]Huazhong Univ Sci & Technol, Dept Radiol, Tongji Hosp, Tongji Med Coll, 1095 Jie Fang Ave, Wuhan 430030, Peoples R China放射科华中科技大学同济医学院附属同济医院[3]Capital Normal Univ, Acad Multidisciplinary Studies, Beijing Natl Ctr Appl Math, Beijing 10048, Peoples R China
Deep learning methods have revolutionized medical image analysis, enabling tasks such as lesion classification, segmentation, and detection. However, these methods rely on annotations, posing a burden on healthcare professionals. In contrast, medical reports contain valuable information, leading to the emergence of Medical Reports Generation from Medical Images (MRGMI). Despite advancements, MRGMI predominantly focuses on English reports, lacking solutions for other languages. To address this and to generate responsible Chinese MRGMI model, we present a Chinese MRGMI dataset of over 40,000 Xray-image-report pairs, covering diverse diseases. We further provide 500 graphnode annotations of the reports and propose the CN-RadGraph model, extracting graph nodes from reports to, in a clinical-responsible way, evaluate our MRGMI model: Chinese X-ray-to-Reports Generation (CNX2RG) model. Considering linguistic disparities, we enhance the SOTA method with prompt training, graph-based augmentation, and sentence shuffling. Our CN-X2RG model shows significant improvements over baselines. The dataset and code are publicly available, fostering clinical-responsible research and development.
语种:
外文
WOS:
第一作者:
第一作者单位:[1]Infervis Med Technol Co Ltd, Beijing, Peoples R China
共同第一作者:
通讯作者:
通讯机构:[1]Infervis Med Technol Co Ltd, Beijing, Peoples R China[3]Capital Normal Univ, Acad Multidisciplinary Studies, Beijing Natl Ctr Appl Math, Beijing 10048, Peoples R China
推荐引用方式(GB/T 7714):
Tang Wen,Pei Chenhao,Yu Pengxin,et al.Generating Chinese Radiology Reports from X-Ray Images: A Public Dataset and an X-ray-to-Reports Generation Method[J].MEDICAL IMAGE COMPUTING AND COMPUTER ASSISTED INTERVENTION, MICCAI 2023 WORKSHOPS.2023,14393:79-88.doi:10.1007/978-3-031-47401-9_8.
APA:
Tang, Wen,Pei, Chenhao,Yu, Pengxin,Zhang, Huan,Min, Xiangde...&Zhang, Rongguo.(2023).Generating Chinese Radiology Reports from X-Ray Images: A Public Dataset and an X-ray-to-Reports Generation Method.MEDICAL IMAGE COMPUTING AND COMPUTER ASSISTED INTERVENTION, MICCAI 2023 WORKSHOPS,14393,
MLA:
Tang, Wen,et al."Generating Chinese Radiology Reports from X-Ray Images: A Public Dataset and an X-ray-to-Reports Generation Method".MEDICAL IMAGE COMPUTING AND COMPUTER ASSISTED INTERVENTION, MICCAI 2023 WORKSHOPS 14393.(2023):79-88