Automated writing evaluation: Does spelling and grammar feedback support high-quality writing and revision?

Kathryn S. McCarthy, Rod D. Roscoe, Laura K. Allen, Aaron D. Likens, Danielle S. McNamara

Research output: Contribution to journalArticlepeer-review

12 Scopus citations

Abstract

The benefits of writing strategy feedback are well established. This study examined the extent to which adding spelling and grammar checkers support writing and revision in comparison to providing writing strategy feedback alone. High school students (n = 119) wrote and revised six persuasive essays in Writing Pal, an automated writing evaluation and tutoring system. All participants received automated strategy feedback after writing the first draft of their essays. Half of the participants were also given access to spelling and grammar checkers while writing. Spelling and grammar feedback on its own had no effect on the quality of students’ first draft. Linear mixed effects models revealed improvements from initial draft to revision on most subscales. The addition of spelling and grammar feedback contributed small but significant gains after revision on five subscales (i.e., mechanics, word choice, voice, conclusion, and organization) but no other aspects of the students’ essays. Qualitative exploration of exemplar students’ revision moves revealed how students incorporated both strategy and spelling and grammar feedback into their revisions. Findings from this study demonstrate that strategy feedback with an opportunity to revise contributed to improved essay quality, but that spelling and grammar feedback provided modest, complementary benefits.

Original languageEnglish (US)
Article number100608
JournalAssessing Writing
Volume52
DOIs
StatePublished - Apr 2022
Externally publishedYes

Bibliographical note

Funding Information:
This research was supported by grants from the U.S. DoEd Institute of Education Sciences (R305A120707 and R305A180261) and the U.S. DoD Office of Naval Research (N000141712300). Opinions, findings, or recommendations expressed in this material are those of the authors and do not necessarily reflect the views of the funding sources.

Publisher Copyright:
© 2022 Elsevier Inc.

Keywords

  • AWE feedback
  • Feedback uptake
  • Mechanics
  • Revision
  • Writing
  • Writing strategies

Fingerprint

Dive into the research topics of 'Automated writing evaluation: Does spelling and grammar feedback support high-quality writing and revision?'. Together they form a unique fingerprint.

Cite this