Development and evaluation of a course integrating machine translation and Generative AI in higher education English learning

Abstract

This study developed and implemented a course aimed at helping students understand the strengths and limitations of machine translation (MT) and generative artificial intelligence (GenAI), utilize these AI tools to produce higher-quality English translations, and apply them to English learning as a second language. Data from 46 students were analyzed using pre- and post-course surveys, measuring their overall course satisfaction, usefulness, and motivation. The survey results showed that most students were satisfied with the course and found it useful for English learning. Further analysis revealed that students found learning the strengths and limitations of MT, pre- and post-editing, and using ChatGPT useful for English learning. In particular, understanding the strengths and limitations of MT and creating their own prompts contributed to overall satisfaction and usefulness. Additionally, students’ self-evaluated achievements in pre- and post-editing contributed to their willingness to continue learning English even as AI develops.