Skip to main navigation Skip to search Skip to main content

Automated Multi-Dimensional Analysis of Peer Feedback in Middle School Mathematics

  • Jiayi Zhang
  • , Ryan S. Baker
  • , J. M.Alexandra Andres
  • , Stephen Hutt
  • , Sheela Sethuraman

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

Abstract

Peer review, a commonly-used pedagogy in contemporary education has been found to positively influence student learning, benefitting both feedback provider and recipient. However, the quality of the feedback may vary, and lower-quality feedback (e.g., lacking specificity), is less likely to be implemented by the recipient, leading to suboptimal outcomes. Although recent work has used criteria to scaffold feedback to ensure quality, it is often difficult to monitor whether students follow these criteria. In this study, we develop models that automatically detect the attributes of student feedback, reflecting the presence of three pedagogically relevant constructs: 1) commenting on the process, 2) commenting on the answer, and 3) relating to self. We find models employing sentence embeddings produce the best results, with AUC ROCs ranging from .90-.96, and are robust to algorithmic bias.

Original languageEnglish (US)
Title of host publicationISLS Annual Meeting 2023
Subtitle of host publicationBuilding Knowledge and Sustaining our Community - 16th International Conference on Computer-Supported Collaborative Learning, CSCL 2023 - Proceedings
EditorsCrina Damsa, Marcela Borge, Elizabeth Koh, Marcelo Worsley
PublisherInternational Society of the Learning Sciences (ISLS)
Pages221-224
Number of pages4
ISBN (Electronic)9781737330684
StatePublished - 2023
Externally publishedYes
Event16th International Conference on Computer-Supported Collaborative Learning, CSCL 2023 - Montreal, Canada
Duration: Jun 10 2023 → Jun 15 2023

Publication series

NameProceedings of International Conference of the Learning Sciences, ICLS
Volume2023-June
ISSN (Print)1814-9316

Conference

Conference16th International Conference on Computer-Supported Collaborative Learning, CSCL 2023
Country/TerritoryCanada
CityMontreal
Period6/10/23 → 6/15/23

Bibliographical note

Publisher Copyright:
© 2023 International Society of the Learning Sciences (ISLS). All rights reserved.

Fingerprint

Dive into the research topics of 'Automated Multi-Dimensional Analysis of Peer Feedback in Middle School Mathematics'. Together they form a unique fingerprint.

Cite this