The RAP system

Automatic feedback of oral presentation skills using multimodal analysis and low-Cost sensors

Xavier Ochoa, Federico Domínguez, Bruno Guamán, Ricardo Maya, Gabriel Falcones, Jaime Castells

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Developing communication skills in higher education students could be a challenge to professors due to the time needed to provide formative feedback. This work presents RAP, a scalable system to provide automatic feedback to entry-level students to develop basic oral presentation skills. The system improves the state-of-the-art by analyzing posture, gaze, volume, filled pauses and the slides of the presenters through data captured by very low-cost sensors. The system also provides an off-line feedback report with multimodal recordings of their performance. An initial evaluation of the system indicates that the system’s feedback highly agrees with human feedback and that students considered that feedback useful to develop their oral presentation skills.

Original languageEnglish (US)
Title of host publicationProceedings of the 8th International Conference on Learning Analytics and Knowledge
Subtitle of host publicationTowards User-Centred Learning Analytics, LAK 2018
PublisherAssociation for Computing Machinery
Pages360-364
Number of pages5
ISBN (Electronic)9781450364003
DOIs
StatePublished - Mar 7 2018
Event8th International Conference on Learning Analytics and Knowledge, LAK 2018 - Sydney, Australia
Duration: Mar 5 2018Mar 9 2018

Other

Other8th International Conference on Learning Analytics and Knowledge, LAK 2018
CountryAustralia
CitySydney
Period3/5/183/9/18

Fingerprint

Feedback
Sensors
Costs
Students
Education
Communication

Keywords

  • Filled-pauses
  • Gaze
  • Multimodal learning analytics
  • Posture

ASJC Scopus subject areas

  • Human-Computer Interaction
  • Computer Networks and Communications
  • Computer Vision and Pattern Recognition
  • Software

Cite this

Ochoa, X., Domínguez, F., Guamán, B., Maya, R., Falcones, G., & Castells, J. (2018). The RAP system: Automatic feedback of oral presentation skills using multimodal analysis and low-Cost sensors. In Proceedings of the 8th International Conference on Learning Analytics and Knowledge: Towards User-Centred Learning Analytics, LAK 2018 (pp. 360-364). Association for Computing Machinery. https://doi.org/10.1145/3170358.3170406

The RAP system : Automatic feedback of oral presentation skills using multimodal analysis and low-Cost sensors. / Ochoa, Xavier; Domínguez, Federico; Guamán, Bruno; Maya, Ricardo; Falcones, Gabriel; Castells, Jaime.

Proceedings of the 8th International Conference on Learning Analytics and Knowledge: Towards User-Centred Learning Analytics, LAK 2018. Association for Computing Machinery, 2018. p. 360-364.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Ochoa, X, Domínguez, F, Guamán, B, Maya, R, Falcones, G & Castells, J 2018, The RAP system: Automatic feedback of oral presentation skills using multimodal analysis and low-Cost sensors. in Proceedings of the 8th International Conference on Learning Analytics and Knowledge: Towards User-Centred Learning Analytics, LAK 2018. Association for Computing Machinery, pp. 360-364, 8th International Conference on Learning Analytics and Knowledge, LAK 2018, Sydney, Australia, 3/5/18. https://doi.org/10.1145/3170358.3170406
Ochoa X, Domínguez F, Guamán B, Maya R, Falcones G, Castells J. The RAP system: Automatic feedback of oral presentation skills using multimodal analysis and low-Cost sensors. In Proceedings of the 8th International Conference on Learning Analytics and Knowledge: Towards User-Centred Learning Analytics, LAK 2018. Association for Computing Machinery. 2018. p. 360-364 https://doi.org/10.1145/3170358.3170406
Ochoa, Xavier ; Domínguez, Federico ; Guamán, Bruno ; Maya, Ricardo ; Falcones, Gabriel ; Castells, Jaime. / The RAP system : Automatic feedback of oral presentation skills using multimodal analysis and low-Cost sensors. Proceedings of the 8th International Conference on Learning Analytics and Knowledge: Towards User-Centred Learning Analytics, LAK 2018. Association for Computing Machinery, 2018. pp. 360-364
@inproceedings{b96fd3d453e545c79576a93f7d11c82e,
title = "The RAP system: Automatic feedback of oral presentation skills using multimodal analysis and low-Cost sensors",
abstract = "Developing communication skills in higher education students could be a challenge to professors due to the time needed to provide formative feedback. This work presents RAP, a scalable system to provide automatic feedback to entry-level students to develop basic oral presentation skills. The system improves the state-of-the-art by analyzing posture, gaze, volume, filled pauses and the slides of the presenters through data captured by very low-cost sensors. The system also provides an off-line feedback report with multimodal recordings of their performance. An initial evaluation of the system indicates that the system’s feedback highly agrees with human feedback and that students considered that feedback useful to develop their oral presentation skills.",
keywords = "Filled-pauses, Gaze, Multimodal learning analytics, Posture",
author = "Xavier Ochoa and Federico Dom{\'i}nguez and Bruno Guam{\'a}n and Ricardo Maya and Gabriel Falcones and Jaime Castells",
year = "2018",
month = "3",
day = "7",
doi = "10.1145/3170358.3170406",
language = "English (US)",
pages = "360--364",
booktitle = "Proceedings of the 8th International Conference on Learning Analytics and Knowledge",
publisher = "Association for Computing Machinery",

}

TY - GEN

T1 - The RAP system

T2 - Automatic feedback of oral presentation skills using multimodal analysis and low-Cost sensors

AU - Ochoa, Xavier

AU - Domínguez, Federico

AU - Guamán, Bruno

AU - Maya, Ricardo

AU - Falcones, Gabriel

AU - Castells, Jaime

PY - 2018/3/7

Y1 - 2018/3/7

N2 - Developing communication skills in higher education students could be a challenge to professors due to the time needed to provide formative feedback. This work presents RAP, a scalable system to provide automatic feedback to entry-level students to develop basic oral presentation skills. The system improves the state-of-the-art by analyzing posture, gaze, volume, filled pauses and the slides of the presenters through data captured by very low-cost sensors. The system also provides an off-line feedback report with multimodal recordings of their performance. An initial evaluation of the system indicates that the system’s feedback highly agrees with human feedback and that students considered that feedback useful to develop their oral presentation skills.

AB - Developing communication skills in higher education students could be a challenge to professors due to the time needed to provide formative feedback. This work presents RAP, a scalable system to provide automatic feedback to entry-level students to develop basic oral presentation skills. The system improves the state-of-the-art by analyzing posture, gaze, volume, filled pauses and the slides of the presenters through data captured by very low-cost sensors. The system also provides an off-line feedback report with multimodal recordings of their performance. An initial evaluation of the system indicates that the system’s feedback highly agrees with human feedback and that students considered that feedback useful to develop their oral presentation skills.

KW - Filled-pauses

KW - Gaze

KW - Multimodal learning analytics

KW - Posture

UR - http://www.scopus.com/inward/record.url?scp=85045899959&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85045899959&partnerID=8YFLogxK

U2 - 10.1145/3170358.3170406

DO - 10.1145/3170358.3170406

M3 - Conference contribution

SP - 360

EP - 364

BT - Proceedings of the 8th International Conference on Learning Analytics and Knowledge

PB - Association for Computing Machinery

ER -