TY - JOUR
T1 - A LAK of Direction
T2 - Misalignment Between the Goals of Learning Analytics and its Research Scholarship
AU - Motz, Benjamin A.
AU - Bergner, Yoav
AU - Brooks, Christopher A.
AU - Gladden, Anna
AU - Gray, Geraldine
AU - Lang, Charles
AU - Li, Warren
AU - Marmolejo-Ramos, Fernando
AU - Quick, Joshua D.
N1 - Publisher Copyright:
© 2023, Society for Learning Analytics Research (SOLAR). All rights reserved.
PY - 2023/8/30
Y1 - 2023/8/30
N2 - Learning analytics (LA) defines itself with a focus on data from learners and learning environments, with corresponding goals of understanding and optimizing student learning. LA research, ideally, should make use of data from learners engaged in education systems, should measure student learning, and should improve these learning environments. However, a common concern among members of the LA research community is that these standards are not being met. In two analyses, we reviewed a large, comprehensive sample of research articles from the proceedings of the three most recent Learning Analytics and Knowledge (LAK) conferences and from articles published in the Journal of Learning Analytics (JLA) in 2020, 2021, and 2022. We found that 37.4% of articles do not analyze data from learners in an education system, 71.1% do not include any measure of learning outcomes, and 89% do not attempt to intervene in the learning environment. We contrast these findings with the stated definition of LA and infer, like others before us, that LA scholarship presently lacks clear direction toward its stated goals. We invite critical discussion of these findings from the LA community, through open peer commentary.
AB - Learning analytics (LA) defines itself with a focus on data from learners and learning environments, with corresponding goals of understanding and optimizing student learning. LA research, ideally, should make use of data from learners engaged in education systems, should measure student learning, and should improve these learning environments. However, a common concern among members of the LA research community is that these standards are not being met. In two analyses, we reviewed a large, comprehensive sample of research articles from the proceedings of the three most recent Learning Analytics and Knowledge (LAK) conferences and from articles published in the Journal of Learning Analytics (JLA) in 2020, 2021, and 2022. We found that 37.4% of articles do not analyze data from learners in an education system, 71.1% do not include any measure of learning outcomes, and 89% do not attempt to intervene in the learning environment. We contrast these findings with the stated definition of LA and infer, like others before us, that LA scholarship presently lacks clear direction toward its stated goals. We invite critical discussion of these findings from the LA community, through open peer commentary.
KW - Learning analytics
KW - systematic review
UR - http://www.scopus.com/inward/record.url?scp=85159920146&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85159920146&partnerID=8YFLogxK
U2 - 10.18608/jla.2023.7913
DO - 10.18608/jla.2023.7913
M3 - Article
AN - SCOPUS:85159920146
SN - 1929-7750
VL - 10
SP - 1
EP - 13
JO - Journal of Learning Analytics
JF - Journal of Learning Analytics
IS - 2
ER -