Approaches to Applying Deep Learning for Early Prediction of Learners' Academic Outcomes
Main Article Content
Abstract
In the context of global digital transformation, the increase in the amount of educational data is the driving force behind modern technological methods applied in educational analysis, notably the application of deep learning in predicting student outcome. Given its potential to mitigate academic challenges and foster positive educational outcomes, the prediction of student learning outcomes emerges as a pivotal research area within educational data mining, capturing the interest of researchers worldwide. This article presents an overview of the application of deep learning in educational data analysis, with a special focus on the problem of predicting student learning outcomes. Some modern research trends in educational science based on data analysis techniques are also mentioned.
References
[2]. Alfy, S. El., Gómez, J.M.& Dani, A. (2019). Exploring the benefits and challenges of learning analytics in higher education institutions: a systematic literature review. Information Discovery and Delivery, 47(1), 25-34. https://doi.org/10.1108/IDD-06-2018-0018
[3]. Arnold, K. E. (2010). “Signals: Applying Academic Analytics. EDUCAUSE Quarterly 33(1).
[4]. Arsad, P.M., Buniyamin, N. and Manan, J-lA. (2013). Prediction of engineering students' academic performance using Artificial Neural Network and Linear Regression: A comparison, International Conference on Engineering Education, https://doi.org/10.1109/ICEED.2013.6908300
[5]. Arsad, P.M., Buniyamin, N. and Manan, J-lA. (2013). A neural network students’ performance prediction model (NNSPPM). 2013 IEEE International Conference on Smart Instrumentation, Measurement and Applications (ICSIMA), (November): 1–5.
[6]. Azcona, D.& Smeaton, A. F. (2017). Targeting at-risk students using engagement and effort predictors in an introductory computer programming course. European Conference on Technology Enhanced Learning, 361–366. Springer, Cham
[7]. Baker, R. S. & Inventado, P. S. (2014). Educational data mining and learning analytics. In Learning analytics (pp. 61–75). Springer, New York, NY
[8]. Bendangnuksung, E. & Prabu, D. (2018), Student’s Performance Prediction Using Deep Neural Network, International Journal of Applied Engineering Research ISSN 0973-4562 Volume 13, Number 2 (2018) pp. 1171-1176.
[9]. Bienkowski, M., Feng, M. and Means, B., Enhancing Teaching and Learning through Educational Data Mining and Learning Analytics, Washington D.C.
[10]. Brooker, Corrin, L., De Barba, P., Lodge, J. & Kennedy, G. (2018), A tale of two MOOCs: How student motivation and participation predict learning outcomes in different MOOCs. Australasian Journal of Educational Technology, 34(1).
[11]. Capuano, N. & Toti, D. (2019). Experimentation of a smart learning system for law based on knowledge discovery and cognitive computing. Computers in Human Behavior, 92, 459- 467. 10.1016/j.chb.2018.03.034.
[12]. Corrigan, O. & Smeaton, A. F. (2017). A Course Agnostic Approach to Predicting Student Success from VLE Log Data Using Recurrent Neural Networks. European Conference on Technology Enhanced Learning, 545–548. Springer.
[13]. Costa, B., Fonseca, B., Santana, M.A., Araújo F.F. and Rego, J., Evaluating the effectiveness of educational data mining techniques for early prediction of students' academic failure in introductory programming courses, Computers in Human Behavior, Volume 73, 2017, Pages 247-256,
[14]. Christou, V., Tsoulos, I., Loupas, V., Tzallas, A.T., Gogos, C., Karvelis, P., Antoniadis, N., Glavas, E. and Giannakeas, N. (2023), Performance and early drop prediction for higher education students using machine learning, Expert Systems with Applications, 225, 120079.
[15]. Daniel, B. K. (2017). Big data in higher education: The big picture. In Big data and learning analytics in higher education (pp. 19–28). Cham, Switzerland: Springer.
[16]. DesJardins, S. L., Ahlburg, D. A. & McCall, B. P. (1999), An event history model of student departure. Economics of Education Review, 18(3), 375e390. http://dx. doi.org/10.1016/S0272-7757(98)00049-1.
[17]. Deng, L and Yu, D. (2014). Deep Learning: Methods and Applications. Foundations and Trends® in Signal Processing, 7(3–4): 197–387.
[18]. Du, X., Yang, J., Hung, J-L. and Shelton, B. (2020). Educational data mining: A systematic review of research and emerging trends. Information Discovery and Delivery, 48(4), 225–236. https://doi.org/10.1108/IDD-09-2019-0070
[19]. Dutt, A., Ismail, M.A. & Herawan, T. (2017). A systematic review on educational data mining. IEEE Access, 5, 15991–16005. https://doi.org/10.1109/ACCESS.2017.2654247
[20]. Emmert-Streib, F., and Dehmer, M. (2019a). Defining data science by a data-driven quantification of the community. Mach. Learn. Knowl. Extract. 1, 235–251. doi: 10.3390/make1010015
[21]. Emmert-Streib, F. and Dehmer, M. (2019b). Evaluation of regression models: model assessment, model selection and generalization error. Mach. Learn. Knowl. Extract. 1, 521–551. doi: 10.3390/make1010032
[22]. Emmert-Streib, F., Yang, Z., Feng, H., Tripathi, S. and Dehmer, M. (2020) An Introductory Review of Deep Learning for Prediction Models With Big Data. Front. Artif. Intell. 3:4. doi: 10.3389/frai.2020.00004
[23]. Fei, M. and Yeung, D-Y. (2015). Temporal Models for Predicting Student Dropout in Massive Open Online Courses. 2015 IEEE International Conference on Data Mining Workshop (ICDMW), 256–263. DOI: https:// doi.org/10.1109/ICDMW.2015.174.
[24]. Gardner, J.N. & Brooks, C. (2018), Student success prediction in MOOCs. User Modeling and User-Adapted Interaction, 28(2), 127–203.
[25]. Gardner, J. N. & Koch, A. K. (2012), The first-year experience thirty years Later: It is time for an evidence-based, intentional plan. In Purdue SoLar Flare practitioners' conference, West Lafayette, IN. Geman, S.
[26]. Girshick, R. (2015) Fast R-CNN. In: 2015 IEEE international conference on computer vision, pp 1440– 1448
[27]. Girshick, R., Donahue, J., Darrell, T. and Malik, J. (2014) Rich feature hierarchies for accurate object detection and semantic segmentation. In: 2014 IEEE Conference on computer vision and pattern recognition, pp 580–587
[28]. Graves, A. (2013). Generating sequences with recurrent neural networks. arXiv [Preprint]. arXiv:1308.0850.
[29]. Graves, A., Mohamed, A., and Hinton, G. E. (2013). “Speech recognition with deep recurrent neural networks,” in 2013 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).
[30]. Graves, A., and Schmidhuber, J. (2005). Framewise phoneme classification with bidirectional LSTM and other neural network architectures. Neural Netw. 18, 602–610. doi: 10.1016/j.neunet.2005.06.042
[31]. Hinton, G. E., and Salakhutdinov, R. R. (2006). Reducing the dimensionality of data with neural networks. Science 313, 504–507. doi: 10.1126/science. 1127647
[32]. Hussain, S., Muhsion, Z. F., Salal, Y. K., Theodorou, P., Kurtoglu, F., and Hazarika, G. (2019), Prediction Model on Student Performance based on Internal Assessment using Deep Learning, International Journal of Emerging Technologies in Learning (iJET), https://doi.org/10.3991/IJET.V14I08.10001
[33]. Hussain, S., Khan, M.Q. (2023) Student-Performulator: Predicting Students’ Academic Performance at Secondary and Intermediate Level Using Machine Learning. Ann. Data. Sci. 10, 637–655 (2023). https://doi.org/10.1007/s40745-021-00341-0
[34]. Iatrellis, O., Savvas, I.K., Fitsilis, P. & Gerogiannis, V.C. (2021), A two-phase machine learning approach for predicting student outcomes. Educ Inf Technol 26, 69–88 (2021). https://doi.org/10.1007/s10639-020-10260-x
[35]. Johnson, L., A. Levine, R. Smith, and S. Stone. 2010. The 2010 Horizon Report. Austin, TX: The New Media Consortium. Horizon reports identify and describe emerging technologies likely to have an impact on college and university campuses within the next five years. http://www.nmc.org/pdf/2010-Horizon-Report.pdf
[36]. Jin, Q., Imbrie, P. K., Lin, J. J. J. & Chen, X. (2011), A multi-outcome hybrid model for predicting student success in engineering. In American society for engineering education annual conference, Vancouver, BC, Canada.
[37]. Johnson, L., R. Smith, H. Willis, A. Levine, and K. Haywood. 2011. The 2011 Horizon Report. Austin, TX: The New Media Consortium. Horizon reports identify and describe emerging technologies likely to have an impact on college and university campuses within the next five years.
[38]. Khalil, M., & Ebner, M. (2015). Learning analytics: Principles and constraints. EdMedia: World Conference on Educational Media and Technology, 1789–1799. Association for the Advancement of Computing in Education (AACE).
[39]. Krizhevsky, A., (2010) Convolutional deep belief networks on cifar-10. Unpublished manuscript, 2010.2011
[40]. Lin T-Y, Goyal P, Girshick R, He K, Dollar P (2017) Focal loss for dense object detection. arXiv:1708.02002
[41]. Krizhevsky, A., Sutskever, I., and Hinton, G. E. (2012a). ImageNet Classification with Deep Convolutional Neural Networks. Curran Associates, Inc.
[42]. Krizhevsky, A., Sutskever, I., and Hinton, G. E. (2012b). “Imagenet classification with deep convolutional neural networks,” in Advances in Neural Information Processing Systems, 1097–1105.
[43]. LeCun, Y., Bengio, Y., & Hinton, G. (2015). Deep learning. Nature, 521(7553), 436.
[44]. Leitner, P., Khalil, M., & Ebner, M. (2017). Learning analytics in higher education—a literature review. In Learning analytics: Fundaments, applications, and trends (pp. 1–23). Springer.
[45]. Leung, M. K. K., Xiong, H. Y., Lee, L. J., and Frey, B. J. (2014). Deep learning of the tissue-regulated splicing code. Bioinformatics 30, 121–129. doi: 10.1093/bioinformatics/btu277
[46]. Mohamed, A.-R., Dahl, G. E., and Hinton, G. (2011). Acoustic modeling using deep belief networks. IEEE Trans. Audio Speech Lang. Process. 20, 14–22. doi: 10.1109/TASL.2011.2109382
[47]. Mubarak, A.A., Cao, H. and Hezam, I.M. (2022), Modeling student’s performance using graph convolutional networks. Complex Intell. Syst. 8, 2183–2201 (2022). https://doi.org/10.1007/s40747-022-00647-3
[48]. Musso, M.F., Hernandez, C. F. R. & Cascallar, E. C. (2020). Predicting key educational outcomes in academic trajectories: A machine-learning approach. Higher Education, 80(5), 875–894.
[49]. Murtaugh, P. A., Burns, L. D. & Schuster, J. (1999). Predicting the retention of university students. Research in Higher Education, 40(3), 355-371.
[50]. Pascarella, E. T. & Terenzini, P. T. (2005). How college affects students: A third decade of research. San Francisco, CA: Jossey-Bass.
[51]. Pernkopf, F., Peharz, R. and Tschiatschek, S. (2013). Introduction to Probabilistic Graphical Models Introduction. Graz, Austria.
[52]. Piety, P. J., Hickey, D. T., & Bishop, M. J. (2014). Educational data sciences: Framing emergent practices for analytics of learning, organizations, and systems. Proceedings of the Fourth International Conference on Learning Analytics and Knowledge, 193–202.
[53]. Riedmiller, M., and Braun, H. (1993). “A direct adaptive method for faster backpropagation learning: the rprop algorithm,” in IEEE International Conference on Neural Networks (IEEE), 586–591.
[54]. Rosenblatt, F. (1957). The Perceptron, A Perceiving and Recognizing Automaton Project Para. Cornell Aeronautical Laboratory.
[55]. Romero, C. & Ventura, S. (2010). Educational data mining: A review of the state of the art. IEEE Transactions on Systems, Man and Cybernetics Part C: Applications and Reviews, 40(6), 601–618. https://doi.org/10.1109/TSMCC.2010.2053532
[56]. Sarikaya, R., Hinton, G. E., and Deoras, A. (2014). Application of deep belief networks for natural language understanding. IEEE/ACM Trans. Audio Speech Lang. Process. 22, 778–784. doi: 10.1109/TASLP.2014.2303296
[57]. Sarwat, S.; Ullah, N.; Sadiq, S.; Saleem, R.; Umer, M.; Eshmawi, A.A.; Mohamed, A.; Ashraf, I. Predicting Students’ Academic Performance with Conditional Generative Adversarial Network and Deep SVM. Sensors 2022, 22, 4834. https://doi.org/10.3390/s22134834
[58]. N.T.K. Son, C.C. Tho, B.T.T. Huong, P.T. Anh, N. Q. Tri, (2021), The application of machine learning in education science research, VNU JOURNAL of SCIENCE, Vol. 37, No. 4 (2021) 19-26.
[59]. N.T.K. Son, N.V. Bien, N. H. Quynh, C.C. Tho (2022). Machine learning based admission data processing for early forecasting students’ learning outcomes, International Journal of Data Warehousing and Mining, 18(1), 1-14.
[60]. N.T.K. Son, N.T. Thong, N.H. Quynh, H.V. Long (2024). Implementation neutrosophy in deep learning models for prediction student outcomes: An application in Hanoi Metropolitan University, SOCO, DOI: 10.1007/s00500-023-09625-4.
[61]. Shorfuzzaman, M., Hossain, M. S., Nazir, A., Muhammad, G., & Alamri, A. (2019). Harnessing the power of big data analytics in the cloud to support learning analytics in mobile learning environment. Computers in Human Behavior, 92, 578-588.
[62]. Siemens, G. (2010). What are learning analytics. Retrieved March, 10, 2011https://score.hva.nl/Bronnen/Learning%20analytics20download%20tekst%20Score.pdf.
[63]. Siemens, G., & Long, P. (2011). Penetrating the fog: Analytics in learning and education. EDUCAUSE Review, 46(5), 31-40.
[64]. Nguyen Thi Kim Son, Chu Cam Tho, Bui Thi Thanh Huong, Phạm Tuan Anh, Nguyen Quoc Tri (2021), The application of machine learning in education science research, VNU JOURNAL of SCIENCE, Vol. 37, No. 4 (2021) 19-26
[65]. Viberg, O., Hatakka, M., Bälter, O., & Mavroudi, A. (2018). The current landscape of learning analytics in higher education. Computers in Human Behavior. 89, 98
[66]. Waheed, H., Hassan, S., Aljohani, N. R., Hardman, J., Nawaz, R. (2019). Predicting Academic Performance of Students from VLE Big Data using Deep Learning Models, Computers in Human Behavior (2019), https://doi.org/10.1016/j.chb.2019.106189
[67]. Wan, L., Zeiler, M., Zhang, S., Cun, Y. L., and Fergus, R. (2013). “Regularization of neural networks using dropconnect,” in Proceedings of the 30th International Conference on Machine Learning (ICML-13), 1058–1066.
[68]. Wasif, M., Waheed, H., Aljohani, N. R., & Hassan, S.-U. (2019). Understanding Student Learning Behavior and Predicting Their Performance. In Cognitive Computing in Technology-Enhanced Learning (pp. 1–28). IGI Global.
[69]. Xu, X., Wang, J., Peng, H., & Wu, R. (2019). Prediction of academic performance associated with internet usage behaviors using machine learning algorithms. Computers in Human Behavior, 98, 166–173.