Measuring contribution in collaborative writing: An adaptive NMF topic modelling approach

Johnny Torres, Alberto Jimenez, Sixto García, Enrique Peláez, Xavier Ochoa

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

In universities worldwide, instructors may spend a significant amount of time reviewing homework and group projects submitted by their students. Web-based technologies, like Google Docs, have provided a platform for students to write documents collaboratively. Currently, those platforms provide limited information on the individual contribution made by each student. Previous studies have focused on the quantitative aspects of individuals' contribution in collaborative writing, while the quality aspect has received less attention. In this paper, we propose a new model to measure not only quantitative input but also the quality of the content that has been contributed to a document written collaboratively in Spanish language. Based on topics-modeling techniques, we use an adaptive non-negative matrix factorization (NMF) model to extract topics from the content of the document, and grade higher students making those contributions. Using Google documents submitted by students to the academic system of our university as part of their projects, experimental results show that compared to other baseline methods such as edits or words count, our model provide a better approximation to the scores given by human reviewers. Therefore, our model can be used as part of an automatic grading subsystem within the academic system, to provide a baseline score of students' contribution in collaborative documents. This will allow instructors to reduce their workload associated with revision and grading of documents and focus their time on more relevant tasks.

Original languageEnglish (US)
Title of host publication2017 4th International Conference on eDemocracy and eGovernment, ICEDEG 2017
EditorsLuis Teran, Luis Teran, Andreas Meier
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages63-70
Number of pages8
ISBN (Electronic)9781509048304
DOIs
StatePublished - Jun 29 2017
Event4th International Conference on eDemocracy and eGovernment, ICEDEG 2017 - Quito, Ecuador
Duration: Apr 19 2017Apr 21 2017

Publication series

Name2017 4th International Conference on eDemocracy and eGovernment, ICEDEG 2017

Other

Other4th International Conference on eDemocracy and eGovernment, ICEDEG 2017
CountryEcuador
CityQuito
Period4/19/174/21/17

Keywords

  • Education technology
  • collaborative writing
  • topic modeling

ASJC Scopus subject areas

  • Computer Networks and Communications
  • Information Systems
  • Sociology and Political Science
  • Communication
  • Public Administration
  • Information Systems and Management
  • Education

Fingerprint Dive into the research topics of 'Measuring contribution in collaborative writing: An adaptive NMF topic modelling approach'. Together they form a unique fingerprint.

  • Cite this

    Torres, J., Jimenez, A., García, S., Peláez, E., & Ochoa, X. (2017). Measuring contribution in collaborative writing: An adaptive NMF topic modelling approach. In L. Teran, L. Teran, & A. Meier (Eds.), 2017 4th International Conference on eDemocracy and eGovernment, ICEDEG 2017 (pp. 63-70). [7962514] (2017 4th International Conference on eDemocracy and eGovernment, ICEDEG 2017). Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/ICEDEG.2017.7962514