Recommendations for the creation of benchmark datasets for reproducible artificial intelligence in radiology.
Publication year
2024Source
Insights Into Imaging, 15, 1, (2024), pp. 248, article 248ISSN
Publication type
Article / Letter to editor
Display more detailsDisplay less details
Organization
Medical Imaging
Journal title
Insights Into Imaging
Volume
vol. 15
Issue
iss. 1
Page start
p. 248
Subject
Medical Imaging - Radboud University Medical CenterAbstract
Various healthcare domains have witnessed successful preliminary implementation of artificial intelligence (AI) solutions, including radiology, though limited generalizability hinders their widespread adoption. Currently, most research groups and industry have limited access to the data needed for external validation studies. The creation and accessibility of benchmark datasets to validate such solutions represents a critical step towards generalizability, for which an array of aspects ranging from preprocessing to regulatory issues and biostatistical principles come into play. In this article, the authors provide recommendations for the creation of benchmark datasets in radiology, explain current limitations in this realm, and explore potential new approaches. CLINICAL RELEVANCE STATEMENT: Benchmark datasets, facilitating validation of AI software performance can contribute to the adoption of AI in clinical practice. KEY POINTS: Benchmark datasets are essential for the validation of AI software performance. Factors like image quality and representativeness of cases should be considered. Benchmark datasets can help adoption by increasing the trustworthiness and robustness of AI.
This item appears in the following Collection(s)
- Academic publications [245106]
- Electronic publications [132422]
- Faculty of Medical Sciences [93207]
- Open Access publications [106000]
Upload full text
Use your RU credentials (u/z-number and password) to log in with SURFconext to upload a file for processing by the repository team.