Multi-Modal Siamese Network for Diagnostically Similar Lesion Retrieval in Prostate MRI
Publication year
2021Source
IEEE Transactions on Medical Imaging, 40, 3, (2021), pp. 986-995ISSN
Publication type
Article / Letter to editor

Display more detailsDisplay less details
Organization
Medical Imaging
Journal title
IEEE Transactions on Medical Imaging
Volume
vol. 40
Issue
iss. 3
Page start
p. 986
Page end
p. 995
Subject
Radboudumc 15: Urological cancers RIHS: Radboud Institute for Health Sciences; Radboudumc 9: Rare cancers RIHS: Radboud Institute for Health SciencesAbstract
Multi-parametric prostate MRI (mpMRI) is a powerful tool to diagnose prostate cancer, though difficult to interpret even for experienced radiologists. A common radiological procedure is to compare a magnetic resonance image with similarly diagnosed cases. To assist the radiological image interpretation process, computerized Content-Based Image Retrieval systems (CBIRs) can therefore be employed to improve the reporting workflow and increase its accuracy. In this article, we propose a new, supervised siamese deep learning architecture able to handle multi-modal and multi-view MR images with similar PIRADS score. An experimental comparison with well-established deep learning-based CBIRs (namely standard siamese networks and autoencoders) showed significantly improved performance with respect to both diagnostic (ROC-AUC), and information retrieval metrics (Precision-Recall, Discounted Cumulative Gain and Mean Average Precision). Finally, the new proposed multi-view siamese network is general in design, facilitating a broad use in diagnostic medical imaging retrieval.
This item appears in the following Collection(s)
- Academic publications [204887]
- Electronic publications [103204]
- Faculty of Medical Sciences [81046]
- Open Access publications [71761]
Upload full text
Use your RU credentials (u/z-number and password) to log in with SURFconext to upload a file for processing by the repository team.