Developing Predictive Models for Computational Thinking Skills of Lower Secondary School Students using Machine Learning Techniques

Main Article Content

Chalita Cheewaviriyanon
Nontasak Janchum

Abstract

Learning outcomes are classified as big data and there is not much research on predicting students' performance at lower secondary school levels. The objectives of this research were to develop predictive models for computational thinking skills of students using machine learning techniques, and to compare the effectiveness of the predictive models for computational thinking skills. The predictive model development utilized a training dataset of 143 records from the basic subject grades of lower secondary students in a school located in Suratthani province. The independent variables consisted of grades in 10 basic subjects, while the dependent variable was the level of computational thinking skills to be predicted.  This research applied a Cross Industry Standard Process for Data Mining (CRISP-DM) framework to develop the predictive models using three machine learning techniques: Naive Bayes, Decision Tree, and K-Nearest Neighbor, and the research also examined such model effectiveness using a 10-fold cross validation technique. The results of the model development to predict computational thinking skills found that the predictive models developed from Naive Bayes, Decision Tree, and K-Nearest Neighbor techniques had an accuracy of 60.05%, 74.95%, and 68.48%, respectively. The results of comparing the model performance to predict computational thinking skills revealed that the predictive model developed from the Decision Tree technique could predict the level of computational thinking skills most effectively among the three models.

Article Details

How to Cite
Cheewaviriyanon, C., & Janchum, N. (2024). Developing Predictive Models for Computational Thinking Skills of Lower Secondary School Students using Machine Learning Techniques . Journal of Inclusive and Innovative Education, 8(1), 120–134. retrieved from https://so01.tci-thaijo.org/index.php/cmujedu/article/view/272244
Section
Research Article

References

Abu Saa, A., Al-Emran, M., & Shaalan, K. (2019). Factors affecting students’ performance in higher education: a systematic review of predictive data mining techniques. Technology, Knowledge and Learning, 24(4), 1-32.

Al-Barrak, M. A., & Al-Razgan, M. (2016). Predicting students final GPA using decision trees: a case study. International Journal of Information and Education Technology, 6(7), 528-533.

Ashraf, A., Anwer, S., & Khan, M. G. (2018). A Comparative study of predicting student’s performance by use of data mining techniques. American Academic Scientific Research Journal for Engineering, Technology, and Sciences, 44(1), 122-136.

Badr, G., Algobail, A., Almutairi, H., & Almutery, M. (2016). Predicting students’ performance in university courses: a case study and tool in KSU mathematics department. Procedia Computer Science, 82, 80-89.

Bakhshinategh, B., Zaiane, O. R., ElAtia, S., & Ipperciel, D. (2018). Educational data mining applications

and tasks: a survey of the last 10 years. Education and Information Technologies, 23(1), 537-553.

Barr, V., & Stephenson, C. (2011). Bringing computational thinking to K-12: what is Involved and what is

the role of the computer science education community?. Acm Inroads, 2(1), 48-54.

Bergin, S., & Reilly, R. (2006). Predicting introductory programming performance: A multi-institutional multivariate study. Computer Science Education, 16(4), 303-323.

Brennan, K., & Resnick, M. (2012). New frameworks for studying and assessing the development of computational thinking. In the 2012 Annual Meeting of the American Educational Research Association, Vancouver. Cannada: The American Educational Research Association.

Buitrago-Flórez, F., Danies, G., Tabima, J., Restrepo, S., & Hernández, C. (2020). Designing a socio-cultural approach for teaching and learning computational thinking. Nordic Journal of Digital Literacy, 15(2), 106-124.

ElGamal, A. (2013). An educational data mining model for predicting student performance in programming course. International Journal of Computer Applications, 70(17), 22-28.

Fernandes, E., Holanda, M., Victorino, M., Borges, V., Carvalho, R., & Van Erven, G. (2019). Educational data mining: Predictive analysis of academic performance of public school students in the capital of Brazil. Journal of Business Research, 94, 335-343.

Géron, A. (2019). Hands-On Machine Learning with Scikit-Learn, Keras, and TensorFlow: Concepts, Tools, and Techniques to Build Intelligent Systems (2 ed.). Sebastopol, CA: O'Reilly Media.

Grover, S., & Pea, R. (2013). Computational thinking in K–12: A review of the state of the field. Educational researcher, 42(1), 38-43.

Harvey, J. L., & Kumar, S. A. (2019). A practical model for educators to predict student performance in K-12 education using machine learning. In 2019 IEEE Symposium Series on Computational Intelligence (SSCI) (pp. 3004-3011). China: Xiamen University.

Institute for the Promotion of Teaching Science and Technology. (2018). Teacher's manual of fundamentals of science and technology (computing science) at primary and secondary levels. Retrieved from http://oho.ipst.ac.th/cs-curriculum-teacher-guide. [in Thai]

Janchum, N.,Cheewaviriyanon, C. (2022). Using data mining techniques to develop a model for scratch programming assessment. Information Teachnology Journal, 18(1), 96-105. [in Thai]

Lawanto, K., Close, K., Ames, C., & Brasiel, S. (2017). Exploring strengths and weaknesses in middle school students’ computational thinking In: Rich, P., Hodges, C. (eds) Emerging research, practice, and policy on xomputational thinking (pp. 307-326). Cham: Springer.

Moreno-León, J., & Robles, G. (2015). Analyze your Scratch projects with Dr. Scratch and assess your computational thinking skills. In the 7th international Scratch conference (pp. 48-53). Amsterdam.

Moreno, J., & Robles, G. (2014). Automatic detection of bad programming habits in scratch: a preliminary study. In 2014 IEEE Frontiers in Education Conference (FIE) (pp. 1-4). Madrid, Spain: IEEE.

Osmanbegovic, E., & Suljic, M. (2012). Data mining approach for predicting student performance. Economic Review: Journal of Economics and Business, 10(1), 3-12.

Phakkachokh, S. (2013). A model for selecting high school program by considering the primary subject records using data mining techniques (Master of science thesis). Faculty of Information Technology, Dhurakij Pundit University. [in Thai]

Qazdar, A., Er-Raha, B., Cherkaoui, C., & Mammass, D. (2019). A machine learning algorithm framework for predicting students performance: A case study of baccalaureate students in Morocco. Education and Information Technologies, 24, 3577-3589.

Rodríguez-Martínez, J. A., González-Calero, J. A., & Sáez-López, J. M. (2020). Computational thinking and mathematics using Scratch: an experiment with sixth-grade students. Interactive Learning Environments, 28(3), 316-327.

Sáez-López, J.-M., Román-González, M., & Vázquez-Cano, E. (2016). Visual programming languages integrated across the curriculum in elementary school: a two year case study using “Scratch” in five schools. Computers & Education, 97, 129-141.

Saraprang, W., Sinlapaninman, U. & Yonwilad, W. (2024). The study of the needs to develop computational thinking skills in computing science for junior high school students. Kalasin University Journal of Humanities Social Sciences and Innovation, 31(1), 52-66. [in Thai]

Scratch team. (2019). Dr.Scratch analyse your Scratch project here!. Retrieved from

http://www.drscratch.org.

Sharda, R., Delen, D., & Turban, E. (2018). Business Intelligence, Analytics, and Data Science: a Managerial Perspective (4 ed.). New York: Pearson.

Tikva, C., & Tambouris, E. (2021). Mapping computational thinking through programming in K-12 education: A conceptual model based on a systematic literature Review. Computers & Education, 162, Article 104083.

Troiano, G. M., Snodgrass, S., Argımak, E., Robles, G., Smith, G., Cassidy, M., Tucker-Raymond, E., Puttick G. & Harteveld, C. (2019, June). Is my game OK Dr. Scratch? Exploring programming and computational thinking development via metrics in student-designed serious games for STEM. In the 18th ACM international Conference on Interaction Design and Children (pp. 208-219). Boise, USA.

Vilailuck, S., Jaroenpuntaruk, V. & Wichadakul, D. (2015). Utilizing data mining techniques to forecast student academic achievement of kasetsart university laboratory school kamphaeng saen campus educational research and development center. Veridian E-Journal Science and Technology, 2(2), 1-17. [in Thai]

Wilson, B. C., & Shrock, S. (2001). Contributing to success in an introductory computer science course:

a study of twelve factors. ACM Sigcse Bulletin, 33(1), 184-188.

Wing, J. (2006). Computational thinking. Communications of the ACM, 49(3), 33-35.

Wing, J., & Stanzione, D. (2016). Progress in computational thinking, and expanding the HPC community. Communications of the ACM, 59(7), 10-11.

Xiao, W., Ji, P., & Hu, J. (2021). A survey on educational data mining methods used for predicting students' performance. Engineering Reports, 4(5), 1-23.

Zhang, L., & Nouri, J. (2019). A systematic review of learning computational thinking through Scratch in K-9. Computers & Education, 141, Article 103607.