1.2)佛山大学物理与光电工程学院,佛山 528225;2.1)中山大学肿瘤防治中心超声科,华南肿瘤学国家重点实验室,肿瘤医学省部共建协同创新中心,广州 510060
国家自然科学基金(82202179)资助项目。
1.2)School of Physics and Optoelectronic Engineering, Foshan University, Foshan 528225, China;2.1)Collaborative Innovation Center of Cancer Medicine, State Key Laboratory of Oncology in South China, Department of Ultrasound, Sun Yat-sen University Cancer Center, Guangzhou 510060, China
This work was supported by a grant from The National Natural Science Foundation of China (82202179).
目的 准确区分LR-M型肝结节中的非典型肝细胞癌(HCC)与其他恶性肿瘤仍是超声诊断的难点。现有深度学习模型多依赖单一模态,未充分挖掘多模态信息的互补价值。为此,本文提出一种注意力加权三模态超声网络(TUS-Net),融合多模态超声信息以提升对非典型HCC的鉴别能力。方法 该模型融合超声造影(CEUS)、B型超声(BUS)及时间-强度曲线(TIC)三种模态。采用C3D主干提取CEUS视频的时空特征;通过双通道特征融合模块(DCFFM)自适应整合CEUS与BUS特征;利用时序强度特征融合模块(TIFFM)引导模型关注TIC所反映的关键时相变化。此外,模型结合YOLOX实现病灶自动定位,并采用类激活映射提升决策可解释性。结果 在包含161例患者的三模态超声数据集上,TUS-Net筛查非典型HCC的准确率达86.83%,敏感性为92.50%,特异性为75.50%,AUC为89.32%。消融实验验证了各模块的有效性,研究表明AI辅助可提升临床医生(尤其是低年资医师)的诊断特异性。结论 该模型表现优于现有基准方法,表明多模态融合结合注意力机制的策略可有效提升疑难肝结节的诊断准确率,为临床提供辅助决策支持。
Objective Discriminating atypical hepatocellular carcinoma (HCC) from other malignancies in liver nodules classified as Liver Imaging Reporting and Data System category M (LR-M) remains a significant diagnostic challenge on conventional ultrasound examination. The LR-M category, originally intended to capture non-HCC malignancies, paradoxically contains up to 63% of atypical HCCs that deviate from classic enhancement patterns, leading to potential misdiagnosis and suboptimal treatment planning. While deep learning has shown promise in HCC diagnosis, most existing models rely exclusively on single-modality ultrasound, overlooking the diagnostic benefits of integrating complementary information from multiple imaging sources. To address this gap, we propose a novel attention-weighted tri-modal ultrasound network (TUS-Net) that integrates contrast-enhanced ultrasound (CEUS), B-mode ultrasound (BUS), and time-intensity curves (TICs) to improve diagnostic accuracy for these clinically challenging lesions.Methods Our framework incorporates a three-dimensional convolutional neural network (C3D) backbone to extract spatiotemporal features from CEUS videos, capturing dynamic vascular patterns critical for lesion characterization. To effectively fuse complementary modalities, we introduce a dual-channel feature fusion module (DCFFM) that adaptively combines features from CEUS and BUS through channel-wise attention mechanisms, allowing the model to dynamically weigh the contribution of each modality based on diagnostic relevance. Additionally, we propose a temporal intensity feature fusion module (TIFFM) that leverages quantitative hemodynamic information from TICs to guide the model’s attention toward diagnostically critical temporal phases, such as arterial wash-in and portal venous washout. The model is further enhanced by automated lesion localization using YOLOX and class activation mapping for interpretability, ensuring that predictions align with clinically meaningful imaging features.Results Evaluated on a tri-modal ultrasound dataset comprising 161 patients with pathologically confirmed LR-M nodules (131 atypical HCC and 30 non-HCC malignancies), our model achieved an accuracy of 86.83%, a sensitivity of 92.50%, a specificity of 75.50%, and an AUC of 89.32% in screening atypical HCC. Compared to single-modality baselines, TUS-Net demonstrated superior specificity, a clinically critical metric given the higher risk associated with misclassifying non-HCC malignancies. Ablation studies confirmed the contribution of each module, with the full model outperforming both standard C3D and 3D ResNet backbones integrated with attention mechanisms. A reader study involving junior and senior radiologists further validated the clinical utility of AI assistance, showing consistent improvements in specificity and inter-reader consistency, particularly for less experienced clinicians.Conclusion These results surpass existing benchmark models and demonstrate the potential of our approach to enhance diagnostic precision in clinically specific cases. By intelligently fusing multi-modal ultrasound data with attention-guided mechanisms, TUS-Net offers a reliable and interpretable tool that holds promise for improving the non-invasive diagnosis of atypical HCC in challenging LR-M liver nodules.
张贺崇,黄良汇,王雪花,江尚霖,陈楹楹,曾亚光,郑玮.注意力加权三模态超声网络(TUS-Net)用于筛查LR-M型肝结节中非典型肝细胞癌[J].生物化学与生物物理进展,2026,53(5):1485-1498 ZHANG He-Chong, HUANG Liang-Hui, WANG Xue-Hua, JIANG Shang-Lin, CHEN Ying-Ying, ZENG Ya-Guang, ZHENG Wei. An Attention-weighted Tri-modal Ultrasound Network (TUS-Net) for Screening of Atypical Hepatocellular Carcinoma From LR-M Liver Nodules[J]. Progress in Biochemistry and Biophysics,2026,53(5):1485-1498
复制

扫码关注 生物化学与生物物理进展 ® 2026 网站版权 ICP:京ICP备05023138号-1 京公网安备 11010502031771号
