PRESERVICE TEACHERS’ ACHIEVEMENT AND RETENTION OF PROBLEM SOLVING SKILLS IN PROGRAMMING : A CHATGPT-BASED FLIPPED CLASSROOM ANALYSIS
DOI:
https://doi.org/10.51200/ijelp.v7i1.5535Keywords:
Artificial Intelligence, ChatGPT, Achievement, Problem-solving, Retention, Programming instructionsAbstract
This pre-experimental study, utilizing a one-group pretest and posttest design, aims to investigate the effects of a ChatGPT-based flipped classroom approach on preservice teachers’ achievement and retention of problem-solving skills in programming. The study sample comprised 33 preservice teachers (one intact class) from an Institute of Teacher Education Malaysia in Sabah, Malaysia, selected through cluster sampling. A Computer Programming Achievement Test (CPAT) were used as the research instrument, which were administered during pretest, posttest and delayed posttest. Data analysis was conducted using one-way repeated measures ANOVA. The results showed an increased in problem-solving skills from the pretest (M=16.84, SD=8.35) to the posttest (M=31.25, SD=13.25), indicating significant improvement in preservice’ teachers achievement. Additionally, retention of problem-solving skills was evident, with the delayed posttest scores (M=24.43, SD=6.68) significantly higher than the pretest scores, though slightly lower than the posttest scores, suggesting some decay over time but overall retention of the skills learned. This research suggests that integrating artificial intelligence (AI) tools, such as ChatGPT, in educational setting can lead to substantial improvements in learning outcomes, which provides valuable resource for educators aiming to foster advanced problem-solving abilities in their students.
References
Abdul Rahman, N., Hashim, N., Yusof, R., Mohd Yunus, S. Y., & Aziz Fadzillah, N. A. (2024). Kesan Kaedah Pengajaran dan Pembelajaran (PdP) Terhadap Penguasaan Pelajar Bagi Kursus Pengaturcaraan.
Adeoye, M. A., & Jimoh, A. (2023). Problem-Solving Skills Among 21st-Century Learners Toward Creativity and Innovation Ideas. Thinking Skills and Creativity Journal, 6(1), 52-58.
Al-Samarraie, H., Shamsuddin, A., & Alzahrani, A. I. (2020). A flipped classroom model in higher education: a review of the evidence across disciplines. Educational Technology Research and Development, 68, 1017-1051.
Bahagian Sumber dan Teknologi Pendidikan. (2023). Dasar Pendidikan Digital. Kementerian Pendidikan Malaysia.
Bouschery, S. G., Blazevic, V., & Piller, F. T. (2023). Augmenting human innovation teams with artificial intelligence: Exploring transformer-based language models. Journal of Product Innovation Management, 40, 139-153.
Dong, W., Li, Y., & Sun, L. Developing pre-service teachers’ computational thinking: a systematic literatur review. International Journal of Technology and Design Education, 34, 191-227.
Erol, O., & Kurt, A. A. (2017). The effects of teaching programming with scratch on pre- service information technology teachers’ motivation and achievement. Computers in Human Behavior, 77, 11-18.
Ettien, A., & Touré, Y. E. J. (2023). Theoritical Foundations of the Flipped Classroom. European Journal of Educationa and Pedagogy, 4(6), 53-57
George, G., & Reddy, R. (2024). Digital Empowerment in Education: Exploring the Dynamics and Significance of ICT – A Review. International Journal of Scientific Research in Engineering and Management, 8(1), 1-10.
Gökoğlu, S., & Kılıç, S. (2023). Programming learning and teaching of pre-service computer science teachers: Challenges, concerns and solutions. E-Learning and Digital Media, 20(5), 498-518.
Güler, M., Kokoç, M., & ÖnderBütüner, S. (2023). Does a flipped classroom model work in mathematics education? A meta-analysis. Education and Information Technologies, 28(1), 57-79.
Gutierrez-Gonzalez, R., Zamarron, A., Royuela, A., & Rodriguez-Boto, G. (2023). Flipped classroom applied to neurosurgery in undergraduate medical education. BMC Medical Education, 23, 170.
Guzdial, M., & Shreiner, T. (2021). Integrating Computing through Task-Specific Programming for Disciplinary Relevance. Computational Thinking in Education. Routledge.
Ha, A. S., O’Reilly, J., Ng, J. Y., & Zhang, J. H. (2019). Evaluating the flipped classroom approach in Asian higher education: Perspectives from students and teachers. Cogent Education, 6(1), 1638147.
Jo, H., & Park, D.-H. (2024). Effects of ChatGPT’s AI capabilities and human-like traits on spreading information in work environments. Scientific Report, 14, 7806.
Kar, S. S., & Ramalingam, A. Is 30 the Magic Number? Issues in Sample Size Estimation. National Journal of Community Medicine, 4(1), 175-179.
Keong, T. C., & JiMei, G. (2024). Analyzing Flipped Classroom Themes Trends in Computer Science Education (2007–2023) Using CiteSpace. Journal of Applied Sciences and Engineering Technology, 46(1), 15-27.
Lee, G., & Zhai, X. (2024). Using ChatGPT for Science Learning: A Study on Pre-service Teachers' Lesson Planning. IEEE Transactions on Learning Technologies, 17, 1683-1700. 10.1109/TLT.2024.3401457
Li, H.-F. (2023). Effects of a ChatGPT-based flipped learning guiding approach on learners’ courseware project performances and perceptions. Australasian Journal of Educational Technology, 39(5), 40-58.
Liao, C.-H., & Wu, J.-Y. (2023). Learning analytics on video-viewing engagement in a flipped statistics course: Relating external video-viewing patterns to internal motivational dynamics and performance. Computers & Education, 197, Article e104754. https://doi.org/10.1016/j.compedu.2023.104754
Lionelle, A., Ghosh, A., Say, B., & Beveridge, J. R. (2022). Increase Performance in CS 2 via a Spiral Redesign of CS 1. In Proceedings of the 53rd ACM Technical Symposium on Computer Science Education - Volume 1 (Providence, RI, USA) (SIGCSE 2022). Association for Computing Machinery, New York, NY, USA, 502–508
Maskur, H., Abdul Mutalib, R., & Abdullah, N. (2020). Hubungan Sikap Pelajar dan Pengajaran Pensyarah Terhadap Pencapaian Kursus Pengaturcaraan di kalangan Pelajar Politeknik. Proceeding International Multidisciplinary Conference (IMC 2020). Annual Conference of the Southern African Computer Lecturers’ Association.
Mazlee Malik. (2019). Guru Perlu Bersedia Tempuh Cabaran Revolusi Industri 4.0. Berita
Harian Online.https://www2.bharian.com.my/berita/pendidikan/2019/05/563340/guru-
perlu-bersedia-tempuh-cabaran-revolusi-industri
Mennega, N., & Mawela, T. (2024). Exploring Flipped Learning in an Introductory Programming Module: A Literature Review. In: Van Rensburg, H.E., Snyman, D.P., Drevin, L., Drevin, G.R. (eds) ICT Education. SACLA 2023. Communications in Computer and Information Science, vol 1862. Springer, Cham.
OpenAI. (2023). ChatGPT: optimizing language models for dialogue. https://openai.com/blog/chatgpt/
Omeh, C. B., & Olelewe, C. J. (2021). Assessing the Effectiveness of Innovative Pedagogy and Lecture Method on Students Academic Achievement and Retention in Computer Programming. Education Research International, 2021(3), 1-11.
Orrù, G., Piarulli, A., Conversano, C. & Gemignani, A. Human-like problem-solving abilities in large language models using ChatGPT. Frontiers in Artificial Intelligence, 6. https://doi.org/10.3389/frai.2023.1199350
Quah, W. B., Banua, N. M., & Zulkifle, Z. (2023). Pembelajaran Berasaskan Permainan Bagi Kursus Asas Pengaturcaraan: Ketahui Sikap dan Minat Pelajar. Journal of ICT in Education, 10(1), 14-25.
Quinstein, M. (2024). Forget Forgetting: AI-Driven Strategies for Learning Retention. https://trainingindustry.com/articles/artificial-intelligence/forget-forgetting-ai-driven strategies-for-learning retention/#:~:text=Artificial%20intelligence%20(AI)%20can%20be,,acquire%20trans lates%20into%20lasting%20skills
Ray, S., & Sikdar, D. P. (2024). AI-Driven Flipped Classroom: Revolutionizing Education Through Digital Pedagogy. British Journal of Educational Learning, 7(2), 169-179.
Roumeliotis, K. I., & Tselikas, N. D. (2023). ChatGPT and Open-AI Models: A Preliminary Review. Future Internet, 15(6), 192.
Rudolph, J., Tan, S., & Tan, S. (2023). ChatGPT: Bullshit Spewer or the End of Traditional Assessments in Higher Education? Journal of Applied Learning and Teaching, 6(10)1-22.
Salleh Hudin, S. (2024). A Pilot Study in Southern Region Primary School: Are Design and Technology Teachers Ready to teach Programming? Online Journal for TVET Practitioners, 9(1), 112-121.
Sarwar, M. A., Saima, M., & Gul, A. (2024). The Role of Artificial Intelligence in Shaping the Future of Education at Higher Secondary Level. Journal of Education and Social Studies, 5(1), 34-45.
Thomas, F. C., Coulombe, S., Girard, T. A., Hart, T. L., Doherty, S., Dass, G., Wickramage, K., Siriwardhana, C., Surenthirakumaran, R., & McShane, K. (2022). Displacement- related stressors in a Sri Lankan war-affected community: Identifying the impact of war exposure and ongoing stressors on trauma symptom severity. SSM – Mental Health, 2.
Verma, M. (2023). Integration of AI-based chatbot (ChatGPT) and supply chain management solution to enhance tracking and queries response. International Journal for Science and Advance Research in Technology, 6(16), 60-63.
Vrotsou, K., Ávila, M., Machón, M., Mateo-Abad, M., Pardo, Y., Garin, O., Zaror, C., González, N., Escobar, A., & Cuéllar, R. (2018). Constant-Murley Score: systematic review and standardized evaluation in different shoulder pathologies. Quality of Life Research, 27(9), 2217-2226.
Voon, X. P., Wong, S. L., Wong, L.-H., Mas Nida Md. Khambari & Sharifah Intan Sharina Syed- Abdullah. (2022). International Journal of Information and Education Technology, 12(6), 529-538.
Yeruva, A. R. (2023). Providing A Personalized Healthcare Service To The PatientsUsing AIOPs Monitoring. Eduvest-Journal of Universal Studies, 3(2), 327-334.
Yu, Z., & Gao, M. (2022). Effects of video length on a flipped English classroom. SAGE Open, 12(1), 1-14. https://doi.org/10.1177/21582440211068474
Yusriza Mohamad Yusof, Afida Ayob & Mohamad Hanif Md Saad. (2021). Penggunaan Teknologi Kejuruteraan dalam Pendidikan STEM Bersepadu. Jurnal Kejuruteraan, 33(1), 1-11.