Role-specific Language Models for Processing Recorded Neuropsychological Exams

Tuka Hanai, Rhoda Au, James Glass

Research output: Chapter in Book/Report/Conference proceedingConference contribution


Neuropsychological examinations are an important screening tool for the presence of cognitive conditions (e.g. Alzheimer’s, Parkinson’s Disease), and require a trained tester to conduct the exam through spoken interactions with the subject. While audio is relatively easy to record, it remains a challenge to automatically diarize (who spoke when?), decode (what did they say?), and assess a subject’s cognitive health. This paper demonstrates a method to determine the cognitive health (impaired or not) of 92 subjects, from audio that was diarized using an automatic speech recognition system trained on TED talks and on the structured language used by testers and subjects. Using leave-one-out cross validation and logistic regression modeling we show that even with noisily decoded data (81% WER) we can still perform accurate enough diarization (0.02% confusion rate) to determine the cognitive state of a subject (0.76 AUC).
Original languageEnglish (US)
Title of host publicationProceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 2 (Short Papers)
PublisherAssociation for Computational Linguistics (ACL)
Number of pages752
StatePublished - Jun 1 2018


Dive into the research topics of 'Role-specific Language Models for Processing Recorded Neuropsychological Exams'. Together they form a unique fingerprint.

Cite this