Understanding Peer Feedback Contributions Using Natural Language Processing

Research output: Chapter in Book/Report/Conference proceedingArticle in proceedingsResearchpeer-review

Documents

  • Mayara Simões de Oliveira Castro
  • Rafael Ferreira Mello
  • Giuseppe Fiorentino
  • Olga Viberg
  • Spikol, Daniel
  • Martine Baars
  • Dragan Gašević

Peer feedback has been widely used in computer-supported collaborative learning (CSCL) setting to improve students’ engagement with massive courses. Although the peer feedback process increases students’ self-regulatory practice, metacognition, and academic achievement, instructors need to go through large amounts of feedback text data which is much more time-consuming. To address this challenge, the present study proposes an automated content analysis approach to identify relevant categories in peer feedback based on traditional and sequence-based classifiers using TF-IDF and content-independent features. We use a data set from an extensive course (N = 231 students) in the setting of engineering higher education. In particular, a total of 2,444 peer feedback messages were analyzed. The CRF classification model based on the TF-IDF features achieved the best performance. The results illustrate that the ability to scale up the automatic analysis of peer feedback provides new opportunities for student-improved learning and improved teacher support in higher education at scale.

Original languageEnglish
Title of host publicationResponsive and Sustainable Educational Futures - 18th European Conference on Technology Enhanced Learning, EC-TEL 2023, Proceedings
EditorsOlga Viberg, Ioana Jivet, Pedro J. Muñoz-Merino, Maria Perifanou, Tina Papathoma
Number of pages16
PublisherSpringer
Publication date2023
Pages399-414
ISBN (Print)9783031426810
DOIs
Publication statusPublished - 2023
EventProceedings of the 18th European Conference on Technology Enhanced Learning, ECTEL 2023 - Aveiro, Portugal
Duration: 4 Sep 20238 Sep 2023

Conference

ConferenceProceedings of the 18th European Conference on Technology Enhanced Learning, ECTEL 2023
LandPortugal
ByAveiro
Periode04/09/202308/09/2023
SeriesLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume14200 LNCS
ISSN0302-9743

Bibliographical note

Publisher Copyright:
© 2023, The Author(s).

    Research areas

  • Computer Supported Collaborative Learning, Content Analysis, Higher Education, Natural Language Processing, Peer Feedback

ID: 390400320