Educational feedback has been widely acknowledged as an effective approach to improving student learning. However, scaling effective practices can be laborious and costly, which motivated researchers to work on automated feedback systems (AFS). Inspired by the recent advancements in the pre-trained language models (e.g., ChatGPT), we posit that such models might advance the existing knowledge of textual feedback generation in AFS because of their capability to offer natural-sounding and detailed responses. Therefore, we aimed to investigate the feasibility of using ChatGPT to provide students with feedback to help them learn better. Our results show that i) ChatGPT is capable of generating more detailed feedback that fluently and coherently summarizes students' performance than human instructors; ii) ChatGPT achieved high agreement with the instructor when assessing the topic of students' assignments; and iii) ChatGPT could provide feedback on the process of students completing the task, which might benefit students developing learning skills.
Can Large Language Models Provide Feedback to Students? A Case Study on ChatGPT
Wei Dai,Jionghao Lin,Hua Jin,Tongguang Li,Yi-Shan Tsai,D. Gašević,Guanliang Chen
Published 2023 in International Conference on Advanced Learning Technologies
ABSTRACT
PUBLICATION RECORD
- Publication year
2023
- Venue
International Conference on Advanced Learning Technologies
- Publication date
2023-07-01
- Fields of study
Computer Science, Education
- Identifiers
- External record
- Source metadata
Semantic Scholar
CITATION MAP
EXTRACTION MAP
CLAIMS
- No claims are published for this paper.
CONCEPTS
- No concepts are published for this paper.
REFERENCES
Showing 1-15 of 15 references · Page 1 of 1