Automated Assessment of Medical Students' Clinical Exposures according to AAMC Geriatric Competencies.

Chen Y, Wrenn J, Xu H, Spickard A, Habermann R, Powers J, Denny JC
AMIA Annu Symp Proc. 2014 2014: 375-84

PMID: 25954341 · PMCID: PMC4419906

Competence is essential for health care professionals. Current methods to assess competency, however, do not efficiently capture medical students' experience. In this preliminary study, we used machine learning and natural language processing (NLP) to identify geriatric competency exposures from students' clinical notes. The system applied NLP to generate the concepts and related features from notes. We extracted a refined list of concepts associated with corresponding competencies. This system was evaluated through 10-fold cross validation for six geriatric competency domains: "medication management (MedMgmt)", "cognitive and behavioral disorders (CBD)", "falls, balance, gait disorders (Falls)", "self-care capacity (SCC)", "palliative care (PC)", "hospital care for elders (HCE)" - each an American Association of Medical Colleges competency for medical students. The systems could accurately assess MedMgmt, SCC, HCE, and Falls competencies with F-measures of 0.94, 0.86, 0.85, and 0.84, respectively, but did not attain good performance for PC and CBD (0.69 and 0.62 in F-measure, respectively).

MeSH Terms (10)

Area Under Curve Artificial Intelligence Clinical Competence Education, Medical, Undergraduate Educational Measurement Geriatrics Humans Natural Language Processing Students, Medical Tennessee

Connections (1)

This publication is referenced by other Labnodes entities: