Exploring AI-Generated Feedback on English Writing: A Case Study of ChatGPT

As a large-scale language model, chatbot ChatGPT has attracted wide attention from the industry and academia since its advent. Its powerful computing power and massive corpus subvert the teacher-centered writing feedback model. Taking college English compositions as the research object, this study compares the feedback of teachers and the feedback of ChatGPT, analyzes the advantages of ChatGPT in grammar revision and punctuation correction (primary modification), vocabulary replacement, semantic fluency and style adjustment (intermediate refinement), and summary writing (high-level output), and provides some references for the application of ChatGPT in English writing and teaching practice.

Ai, X. Q. (2021). A contrastive study of teacher feedback and Pigai intelligent feedback in senior middle school English writing (Master’s thesis, Jiangxi Normal University). Retrieved from https://link.cnki.net/doi/10.27178/d.cnki.gjxsu.2021.001265 doi:10.27178/d.cnki.gjxsu.2021.001265

Atlas, S. (2023). ChatGPT for higher education and professional development: A guide to conversational AI. Retrieved from https://digitalcommons.uri.edu/cba_facpubs/548

Cao, Y. Y., & Zhao, G. X. (2023). Research on second language writing feedback aided by automatic writing assessment system—A case study of correcting network. English on Campus, 24(46), 13-15.

Chandler, J. (2003). The efficacy of various kinds of error feedback for improvement in the accuracy and fluency of L2 student writing. Journal of Second Language Writing, 12, 267-296. Retrieved from https://doi.org/10.1016/S1060-3743(03)00038-9

Chen, C. F. E., & Cheng, W. Y. E. (2008). Beyond the design of automated writing evaluation: Pedagogical practices and perceived learning effectiveness in EFL writing classes. Language Learning & Technology, 12(2), 94-112. Retrieved from http://dx.doi.org/10125/44145

Chen, X. X., & Li, H. N. (2009). The effects of teachers’ written corrective feedback on English writing. Journal of FLTR, 2009, 41(5): 351-358 Retrieved from http://old.fltr.ac.cn/CN/Y2009/V41/I5/351

El Ebyary, K., & Windeatt, S. (2010). The impact of computer-based feedback on students’ written work. International Journal of English Studies, 10(2), 121-142. Retrieved from https://doi.org/10.6018/ijes/2010/2/119231

Ferris, D. R. (1997). The influence of teacher commentary on student revision. TESOL Quarterly, 31, 315-329. Retrieved from https://doi.org/10.2307/3588049

Ferris, D. R., & Roberts, B. (2001). Error feedback in L2 writing classes: How explicit does it need to be. Journal of Second Language Writing, 10(3), 161-184. Retrieved from https://doi.org/10.1016/S1060-3743(01)00039-X

Geng, J., & Razali, A. B. (2020). Tapping the potential of Pigai automated writing evaluation (AWE) program to give feedback on EFL writing. Universal Journal of Educational Research, 8(12B), 8334-8343. Retrieved from https://doi.org/10.13189/ujer.2020.082638

Grimes, D., & Warschauer, M. (2010). Utility in a fallible tool: A multi-site case study of automated writing evaluation. Journal of Technology, Learning, and Assessment, 8(6), 1-44.

Guo, Q., Feng, R. L., & Hua, Y. F. (2022). How effectively can EFL students use automated written corrective feedback (AWCF) in research writing? Computer Assisted Language Learning, 35(9), 2312-2331.

Guo, Q., Feng, R. L., & Hua, Y. F. (2023a). Automated written corrective feedback in research paper revision: The good, the bad, and the missing. London and New York: Routledge.

Guo, Q., Feng, R. L., & Hua, Y. F. (2023b). Using ChatGPT in English academic writing: Benefits and issues. Technology Enhanced Foreign Language Education, 45(2), 18-23+107.

Hong, Y. (2023). How I use ChatGPT responsibly in my teaching. Nature Career Column, 4. Retrieved from https://www.nature.com/articles/d41586-023-01026-9

Li, X. Y. (2014). The effects of different types of teacher written corrective feedback on English writing accuracy of senior high school students (Doctoral dissertation, Capital Normal University).

Link, S., Mehrzad, M., & Rahimi, M. (2022). Impact of automated writing evaluation on teacher feed- back, student revision, and writing improvement. Computer Assisted Language Learning, 35(4), 605-634. Retrieved from https://doi.org/10.1080/09588221.2020.1743323

Open AI. (2022). ChatGPT: Optimizing language models for dialogue. Retrieved January 7, 2023, from https://openai.com/blog/chatgpt/

Ranalli, J. (2018). Automated written corrective feedback: How well can students make use of it? Computer Assisted Language Learning, 31(7), 653-674. Retrieved from https://doi.org/10.1080/09588221.2018.1428994

Thorp, H. H. (2023). ChatGPT is fun, but not an author. Science, 379, 313-313. Retrieved from https://doi.org/10.1126/science.adg7879

Truscott, J. (1999). The case for “the case against grammar correction in L2 writing classes”: A response to Ferris. Journal of Second Language Writing, 8(2), 111-122. Retrieved from https://doi.org/10.1016/S1060-3743(99)80110-6

Wang, J. J. (2006). General attitude, types of feedback and types of error correction: A probe into the written feedback of college English teachers. Foreign Language Learning Theory and Practice, 26(3), 24-30.