Scientific article
OA Policy
English

A Deep Learning System for Automated Quality Evaluation of Optic Disc Photographs in Neuro-Ophthalmic Disorders

Published inDiagnostics, vol. 13, no. 1, 160
First online date2023-01-03
Abstract

The quality of ocular fundus photographs can affect the accuracy of the morphologic assessment of the optic nerve head (ONH), either by humans or by deep learning systems (DLS). In order to automatically identify ONH photographs of optimal quality, we have developed, trained, and tested a DLS, using an international, multicentre, multi-ethnic dataset of 5015 ocular fundus photographs from 31 centres in 20 countries participating to the Brain and Optic Nerve Study with Artificial Intelligence (BONSAI). The reference standard in image quality was established by three experts who independently classified photographs as of "good", "borderline", or "poor" quality. The DLS was trained on 4208 fundus photographs and tested on an independent external dataset of 807 photographs, using a multi-class model, evaluated with a one-vs-rest classification strategy. In the external-testing dataset, the DLS could identify with excellent performance "good" quality photographs (AUC = 0.93 (95% CI, 0.91-0.95), accuracy = 91.4% (95% CI, 90.0-92.9%), sensitivity = 93.8% (95% CI, 92.5-95.2%), specificity = 75.9% (95% CI, 69.7-82.1%) and "poor" quality photographs (AUC = 1.00 (95% CI, 0.99-1.00), accuracy = 99.1% (95% CI, 98.6-99.6%), sensitivity = 81.5% (95% CI, 70.6-93.8%), specificity = 99.7% (95% CI, 99.6-100.0%). "Borderline" quality images were also accurately classified (AUC = 0.90 (95% CI, 0.88-0.93), accuracy = 90.6% (95% CI, 89.1-92.2%), sensitivity = 65.4% (95% CI, 56.6-72.9%), specificity = 93.4% (95% CI, 92.1-94.8%). The overall accuracy to distinguish among the three classes was 90.6% (95% CI, 89.1-92.1%), suggesting that this DLS could select optimal quality fundus photographs in patients with neuro-ophthalmic and neurological disorders affecting the ONH.

Keywords
  • Artificial intelligence
  • Deep learning
  • Optic nerve head
  • Papilledema
  • Retinal image quality assessment
Citation (ISO format)
CHAN, Ebenezer et al. A Deep Learning System for Automated Quality Evaluation of Optic Disc Photographs in Neuro-Ophthalmic Disorders. In: Diagnostics, 2023, vol. 13, n° 1, p. 160. doi: 10.3390/diagnostics13010160
Main files (1)
Article (Published version)
Secondary files (5)
Appendix - Figure 1
accessLevelPublic
Appendix - Figure 2
accessLevelPublic
Appendix - Figure 3
accessLevelPublic
Show more
Identifiers
Additional URL for this publicationhttps://www.mdpi.com/2075-4418/13/1/160
Journal ISSN2075-4418
49views
43downloads

Technical informations

Creation16/02/2025 09:48:29
First validation19/03/2025 07:55:19
Update19/03/2025 07:55:19
Status update19/03/2025 07:55:19
Last indexation19/03/2025 07:55:21
All rights reserved by Archive ouverte UNIGE and the University of GenevaunigeBlack