TY - JOUR
T1 - Multi-level longitudinal learning curve regression models integrated with item difficulty metrics for deliberate practice of visual diagnosis
T2 - groundwork for adaptive learning
AU - Reinstein, Ilan
AU - Hill, Jennifer
AU - Cook, David A.
AU - Lineberry, Matthew
AU - Pusic, Martin V.
N1 - Funding Information:
This work was funded by the U.S. Department of Defense Medical Simulation and Information Sciences Research Program Grant Number W81XWH-16-1-0797. The funding source played no role in the design and conduct of the study. The authors would like to acknowledge the support in developing the ECG dataset by the full grant team including Drs. Julie Friedman, Joseph Bennett, David Rhee, Barry Rosenzweig and Jeffrey Lorin. The elbow radiograph dataset is provided courtesy of Drs. Kathy Boutis and Martin Pecaric with that work having been funded by a Royal College of Physicians and Surgeons of Canada Medical Education Research Grant.
Publisher Copyright:
© 2021, The Author(s), under exclusive licence to Springer Nature B.V. part of Springer Nature.
PY - 2021/8
Y1 - 2021/8
N2 - Visual diagnosis of radiographs, histology and electrocardiograms lends itself to deliberate practice, facilitated by large online banks of cases. Which cases to supply to which learners in which order is still to be worked out, with there being considerable potential for adapting the learning. Advances in statistical modeling, based on an accumulating learning curve, offer methods for more effectively pairing learners with cases of known calibrations. Using demonstration radiograph and electrocardiogram datasets, the advantages of moving from traditional regression to multilevel methods for modeling growth in ability or performance are demonstrated, with a final step of integrating case-level item-response information based on diagnostic grouping. This produces more precise individual-level estimates that can eventually support learner adaptive case selection. The progressive increase in model sophistication is not simply statistical but rather brings the models into alignment with core learning principles including the importance of taking into account individual differences in baseline skill and learning rate as well as the differential interaction with cases of varying diagnosis and difficulty. The developed approach can thus give researchers and educators a better basis on which to anticipate learners’ pathways and individually adapt their future learning.
AB - Visual diagnosis of radiographs, histology and electrocardiograms lends itself to deliberate practice, facilitated by large online banks of cases. Which cases to supply to which learners in which order is still to be worked out, with there being considerable potential for adapting the learning. Advances in statistical modeling, based on an accumulating learning curve, offer methods for more effectively pairing learners with cases of known calibrations. Using demonstration radiograph and electrocardiogram datasets, the advantages of moving from traditional regression to multilevel methods for modeling growth in ability or performance are demonstrated, with a final step of integrating case-level item-response information based on diagnostic grouping. This produces more precise individual-level estimates that can eventually support learner adaptive case selection. The progressive increase in model sophistication is not simply statistical but rather brings the models into alignment with core learning principles including the importance of taking into account individual differences in baseline skill and learning rate as well as the differential interaction with cases of varying diagnosis and difficulty. The developed approach can thus give researchers and educators a better basis on which to anticipate learners’ pathways and individually adapt their future learning.
KW - Adaptive Learning
KW - Electrocardiograms
KW - Item-response theory
KW - Learning curves
KW - Multi-level modelling
KW - Predictive analytics
KW - Radiology
KW - Statistical modelling
UR - http://www.scopus.com/inward/record.url?scp=85101850801&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85101850801&partnerID=8YFLogxK
U2 - 10.1007/s10459-021-10027-0
DO - 10.1007/s10459-021-10027-0
M3 - Article
C2 - 33646468
AN - SCOPUS:85101850801
SN - 1382-4996
VL - 26
SP - 881
EP - 912
JO - Advances in Health Sciences Education
JF - Advances in Health Sciences Education
IS - 3
ER -