Core outcomes measures in dental computer vision studies (DentalCOMS)

Martha Büttner, Rata Rokhshad, Janet Brinz, Julien Issa, Akhilanand Chaurasia, Sergio E. Uribe, Teodora Karteva, Sanaa Chala, Antonin Tichy, Falk Schwendicke (Corresponding Author)

Research output: Contribution to journalArticlepeer-review

1 Citation (Scopus)
3 Downloads (Pure)

Abstract

Objectives: To improve reporting and comparability as well as to reduce bias in dental computer vision studies, we aimed to develop a Core Outcome Measures Set (COMS) for this field. The COMS was derived consensus based as part of the WHO/ITU/WIPO Global Initiative AI for Health (WHO/ITU/WIPO AI4H). Methods: We first assessed existing guidance documents of diagnostic accuracy studies and conducted interviews with experts in the field. The resulting list of outcome measures was mapped against computer vision modeling tasks, clinical fields and reporting levels. The resulting systematization focused on providing relevant outcome measures whilst retaining details for meta-research and technical replication, displaying recommendations towards (1) levels of reporting for different clinical fields and tasks, and (2) outcome measures. The COMS was consented using a 2-staged e-Delphi, with 26 participants from various IADR groups, the WHO/ITU/WIPO AI4H, ADEA and AAOMFR. Results: We assigned agreed levels of reporting to different computer vision tasks. We agreed that human expert assessment and diagnostic accuracy considerations are the only feasible method to achieve clinically meaningful evaluation levels. Studies should at least report on eight core outcome measures: confusion matrix, accuracy, sensitivity, specificity, precision, F-1 score, area-under-the-receiver-operating-characteristic-curve, and area-under-the-precision-recall-curve. Conclusion: Dental researchers should aim to report computer vision studies along the outlined COMS. Reviewers and editors may consider the defined COMS when assessing studies, and authors are recommended to justify when not employing the COMS. Clinical significance: Comparing and synthesizing dental computer vision studies is hampered by the variety of reported outcome measures. Adherence to the defined COMS is expected to increase comparability across studies, enable synthesis, and reduce selective reporting.

Original languageEnglish
Article number105318
Pages (from-to)1-7
Number of pages7
JournalJournal of Dentistry
Volume150
DOIs
Publication statusPublished - Nov 2024

Keywords*

  • AI
  • Computer vision
  • Deep learning
  • Image analysis
  • Radiograph

Field of Science*

  • 3.2 Clinical medicine

Publication Type*

  • 1.1. Scientific article indexed in Web of Science and/or Scopus database

Fingerprint

Dive into the research topics of 'Core outcomes measures in dental computer vision studies (DentalCOMS)'. Together they form a unique fingerprint.

Cite this