Activities per year
Abstract
Objectives: To improve reporting and comparability as well as to reduce bias in dental computer vision studies, we aimed to develop a Core Outcome Measures Set (COMS) for this field. The COMS was derived consensus based as part of the WHO/ITU/WIPO Global Initiative AI for Health (WHO/ITU/WIPO AI4H). Methods: We first assessed existing guidance documents of diagnostic accuracy studies and conducted interviews with experts in the field. The resulting list of outcome measures was mapped against computer vision modeling tasks, clinical fields and reporting levels. The resulting systematization focused on providing relevant outcome measures whilst retaining details for meta-research and technical replication, displaying recommendations towards (1) levels of reporting for different clinical fields and tasks, and (2) outcome measures. The COMS was consented using a 2-staged e-Delphi, with 26 participants from various IADR groups, the WHO/ITU/WIPO AI4H, ADEA and AAOMFR. Results: We assigned agreed levels of reporting to different computer vision tasks. We agreed that human expert assessment and diagnostic accuracy considerations are the only feasible method to achieve clinically meaningful evaluation levels. Studies should at least report on eight core outcome measures: confusion matrix, accuracy, sensitivity, specificity, precision, F-1 score, area-under-the-receiver-operating-characteristic-curve, and area-under-the-precision-recall-curve. Conclusion: Dental researchers should aim to report computer vision studies along the outlined COMS. Reviewers and editors may consider the defined COMS when assessing studies, and authors are recommended to justify when not employing the COMS. Clinical significance: Comparing and synthesizing dental computer vision studies is hampered by the variety of reported outcome measures. Adherence to the defined COMS is expected to increase comparability across studies, enable synthesis, and reduce selective reporting.
Original language | English |
---|---|
Article number | 105318 |
Pages (from-to) | 1-7 |
Number of pages | 7 |
Journal | Journal of Dentistry |
Volume | 150 |
DOIs | |
Publication status | Published - Nov 2024 |
Keywords*
- AI
- Computer vision
- Deep learning
- Image analysis
- Radiograph
Field of Science*
- 3.2 Clinical medicine
Publication Type*
- 1.1. Scientific article indexed in Web of Science and/or Scopus database
Fingerprint
Dive into the research topics of 'Core outcomes measures in dental computer vision studies (DentalCOMS)'. Together they form a unique fingerprint.-
Can we trust clinical AI diagnosis?
E. Uribe, S. (Keynote speaker)
18 Oct 2024 → 19 Oct 2024Activity: Talk or presentation types › Oral presentation
File -
It Sees, It Talks, It Walks - Artificial Intelligence in Dentistry - What It Is, How It Works, and What It Can Do for Dental Practice and Education
E. Uribe, S. (Invited speaker)
12 Sept 2024Activity: Talk or presentation types › Invited talk