Evaluation of The Effectiveness of Generative AI and Artificial Intelligence Creates as Virtual Teaching Assistants to Enhance Student Learning in The Faculty of Education, Bangkokthonburi University

Abstract

The purpose of this research was to (1) evaluate the accuracy and effectiveness of Generative AI and Artificial intelligence creates in providing academic responses as virtual teaching assistants (AI Tutors) to enhance students’ learning, (2) compare students’ learning achievement before and after learning through AI Tutors, and (3) ‍examine the satisfaction of students and instructors toward the use of AI Tutors in teaching and learning processes. The participants were 20 undergraduate students majoring in Educational Technology and Communication at the Faculty of Education, Bangkok Thonburi University, during the first semester of the academic year 2025, selected through purposive sampling. The research instruments included a learning achievement test, a satisfaction questionnaire, and an AI response evaluation form. The experiment was conducted over three weeks (nine hours in total). Students were given a pre-test, engaged in learning activities using Generative AI and Artificial intelligence creates as AI Tutors, and completed a post-test followed by a satisfaction survey.

The findings revealed that: Generative AI and Artificial intelligence creates demonstrated a high level of effectiveness in providing academic responses. Generative AI showed strengths in clarity and structured explanations, while Artificial intelligence creates was outstanding in offering up-to-date information and technological references. Students’ post-test scores were significantly higher than their pre-test scores at the .001 level, indicating that the use of AI Tutors effectively enhanced students’ learning achievement. And Students and instructors reported a very high level of satisfaction with AI Tutor usage, particularly regarding accessibility, responsiveness, and improved understanding of course content. In conclusion, both Generative AI and Artificial intelligence creates effectively functioned as virtual teaching assistants that promote personalized learning and active learning among students. However, the integration of AI in educational contexts should be supervised by instructors to ensure appropriate and ethical use of technology in learning environments.