Scaling and Adopting a Multimodal Learning Analytics Application in an Institution-Wide Setting

Multimodal learning analytics, which is collection, analysis, and report of diverse learning traces to better understand and improve the learning process, has been producing a series of interesting prototypes to analyze learning activities that were previously hard to objectively evaluate. However, none of these prototypes have been taken out of the laboratory and integrated into real learning settings. This article is the first to propose, execute, and evaluate a process to scale and deploy one of these applications, an automated oral presentation feedback system, into an institution-wide setting. Technological, logistical, and pedagogical challenges and adaptations are discussed. An evaluation of the use and effectiveness of the deployment shows both successful adoption and moderate learning gains, especially for low-performing students. In addition, the recording and summarizing of the perception of both instructors and students point to a generally positive experience in spite of the common problems of a first-generation deployment of a complex learning technology.