Validating retinal fundus image analysis algorithms: issues and a proposal.

Trucco E, Ruggeri A, Karnowski T, Giancardo L, Chaum E, Hubschman JP, Al-Diri B, Cheung CY, Wong D, Abràmoff M, Lim G, Kumar D, Burlina P, Bressler NM, Jelinek HF, Meriaudeau F, Quellec G, Macgillivray T, Dhillon B
Invest Ophthalmol Vis Sci. 2013 54 (5): 3546-59

PMID: 23794433 · PMCID: PMC4597487 · DOI:10.1167/iovs.12-10347

This paper concerns the validation of automatic retinal image analysis (ARIA) algorithms. For reasons of space and consistency, we concentrate on the validation of algorithms processing color fundus camera images, currently the largest section of the ARIA literature. We sketch the context (imaging instruments and target tasks) of ARIA validation, summarizing the main image analysis and validation techniques. We then present a list of recommendations focusing on the creation of large repositories of test data created by international consortia, easily accessible via moderated Web sites, including multicenter annotations by multiple experts, specific to clinical tasks, and capable of running submitted software automatically on the data stored, with clear and widely agreed-on performance criteria, to provide a fair comparison.

MeSH Terms (9)

Algorithms Fundus Oculi Humans Image Processing, Computer-Assisted Ophthalmoscopy Reference Standards Reproducibility of Results Retinal Diseases Software

Connections (1)

This publication is referenced by other Labnodes entities: