Student Engagement in E-Learning During Crisis: An Unsupervised Machine Learning and Exploratory Data Analysis Approach

Rachid Ait Daoud, Abdellah Amine, Karim Abouelmehdi, Ayoub Razouk
Pages 508-525
Abstract Views 677
PDF Downloads 594
Crossref Citations -
DOI https://doi.org/10.47738/jads.v6i1.458

Abstract


The lockdown caused by COVID-19 has forced educational institutions to rapidly adopt e-learning, which has revealed many significant challenges related to student engagement. Following the CRISP-DM (Cross-Industry Standard Process for Data Mining) methodology, the present work aims to provide teachers and university administrators with a framework based on unsupervised machine learning and exploratory data analysis to identify engagement levels and understand the potential reasons for low engagement. Various data sources, including Microsoft Teams logs, demographic, and educational data, were merged to create a comprehensive dataset with the most relevant and useful measures for the success of our approach. This study was structured around three main research questions to achieve our goal. First, we sought to identify the most effective Microsoft Teams measures for identifying students' engagement levels. Then, our analysis focused on comparing different clustering models (two-level, three-level, and four-level models) to determine which one is most accurate in identifying low-engaged students. Finally, we examined the demographic and educational factors influencing low student engagement. The results revealed that: by applying the Sequential Forward Selection (SFS) technique, ScreenShareTime, VideoTime, NbrViewedVideos, Recency, and AvgTeamsSessionDay are the most relevant Microsoft Teams engagement metrics, improving the silhouette width from 0.37 to 0.70 when using these selected measurements. The four-level clustering model (Low, Medium, High, and Super) proved most effective in identifying low-engaged students. Analysis of factors showed that low engagement is primarily related to limited living conditions, with 66% of low-engaged students having low incomes. In addition, 50% do not use online services and 62% of low-engaged students took more than three years to reach their final year, indicating pre-existing academic difficulties. These findings provide educational institutions with valuable insights to enhance student engagement in distance learning, particularly during crisis periods such as the COVID-19 pandemic.

Keywords


Educational Data Mining; CRISP-DM Methodology; Log Files; Feature Selection Method; K-means; E-learning; Engagement Metrics

Full Text:

PDF

References


Ruiz, Jorge G., MD; Mintzer, Michael J., MD; Leipzig, Rosanne M., MD, PhD "The Impact of E-Learning in Medical Education, Academic Medicine": March 2006 - Volume 81 - Issue 3, pp. 207-212

I Putu Wisna Ariawan, Wayan Sugandini, I Made Ardana, Gusti Ayu Dessy Sugiharni, Adie Wahyudi Oktavia Gama, Dewa Gede Hendra Divayana, "Forms and Field Trials of a Digital Evaluation Tool: Integrating F-S Model, WP Method, and Balinese Local Wisdom for Effective E-Learning", Journal of Applied Data Sciences; Vol 5, No 2: MAY 2024, pp. 441-454 DO - 10.47738/jads.v5i2.201, https://bright-journal.org/Journal/index.php/JADS/article/view/201

Akmal Akmal, "Predicting Dropout on E-learning Using Machine Learning, Journal of Applied Data Sciences", Vol 1, No 1: SEPTEMBER 2020, pp. 29-34 DO - 10.47738/jads.v1i1.9, https://bright-journal.org/Journal/index.php/JADS/article/view/9

Enseignenemnt au temps de COVID au Maroc, Rapport thématique, Résumé, Conseil Supérieur de l'Education, de la Formation et de la Recherche Scientifique, https://www.csefrs.ma/wp-content/uploads/2021/11/Re%CC%81sume%CC%81-Rapport-Enseignement-au-temps-de-COVID.pdf

Popescu, E. (2009). “Diagnosing students’ learning style in an educational hypermedia system”. Cognitive and emotional processes in Web based education: Integrating human factors and personalization, advances in Web-based learning book series, IGI Global, 187-208.

Bahiah Ahmad, Umi Farhana Alias, Nadirah Mohamad, Norazah Yusof, Principal Component Analysis and Self-Organizing Map Clustering for Student Browsing Behaviour Analysis, Procedia Computer Science, Volume 163, 2019, Pages 550-559, ISSN 1877-0509, https://doi.org/10.1016/j.procs.2019.12.137

Jeljeli, R., Farhi, F., Setoutah, S & Laghouag, A. (2022). Microsoft teams’ acceptance for the e-learning purposes during Covid-19 outbreak: A case study of UAE.International Journal of Data and Network Science, 6(3), 629-640.

Srinivasan, D.K. (2020), Medical Students' Perceptions and an Anatomy Teacher's Personal Experience Using an e‐Learning Platform for Tutorials During the Covid‐19 Crisis. Anat Sci Educ, 13: 318-319. doi:10.1002/ase.1970

Downes S R, Lykina T (May 07, 2020) Closing the Gap in Global Neurosurgical Education via Online Conference: A Pre-Covid Survey. Cureus 12(5): e8015. DOI 10.7759/cureus.8015

Thomas Favale, Francesca Soro, Martino Trevisan, Idilio Drago, Marco Mellia (May 2020), Campus traffic and e-Learning during COVID-19 pandemic, Computer Networks, Volume 176, 2020, 107290, https://doi.org/10.1016/j.comnet.2020.107290

Chick RC, Clifton GT, Peace KM, Propper BW, Hale DF, Alseidi AA, Vreeland TJ (2020), Using technology to maintain the education of residents during the COVID-19 pandemic. J Surg Educ. https://doi.org/10.1016/j.jsurg.2020.03.018

Mohammed K A Kaabar (April 2020), Innovative Teaching Techniques for the COVID-19World, https://www.evmonews.com/post/e-learning-covid-19-world

Yuet-Ming Ng, Pui Lai Peggy Or (April 2020), Coronavirus disease (COVID-19) prevention: Virtual classroom education for hand hygiene, Nurse Education in Practice, Volume 45, 2020, 102782, https://doi.org/10.1016/j.nepr.2020.102782

Oyeniran, Oluwashina A., Oyeniran, Stella T. , Oyeniyi, Joshua O., Ogundele, Rita A. , Ojo, Adeolu O (2020), E-Learning: Advancement in Nigerian Pedagogy Amid Covid-19 Pandemic, International Journal of Multidisciplinary Sciences and Advanced Technology, Volume 1, Special Issue Covid-19 (2020) pp. 85-94

Moreno-Guerrero, A.-J.; Aznar-Díaz, I.; Cáceres-Reche, P.; Alonso-García, S. E-Learning in the Teaching of Mathematics: An Educational Experience in Adult High School. Mathematics 2020, 8, 840.

Clow, D. (2013). An overview of learning analytics. Teaching in Higher Education, 18(6), 683–695.

Jo, I. H., Kim, D., & Yoon, M. (2015). Constructing proxy variables to measure adult learners' time management strategies in LMS. Educational Technology & Society, 18(3), 214–225.

Kudratdeep Aulakh, Rajendra Kumar Roul, Manisha Kaushal,E-learning enhancement through educational data mining with Covid-19 outbreak period in backdrop: A review, International Journal of Educational Development, Volume 101, 2023, 102814, ISSN 0738-0593,https://doi.org/10.1016/j.ijedudev.2023.102814,

Jie W., Hai-yan L., Biao C., Yuan Z. Application of educational data mining on analysis of students’ online learning behavior. In: 2017 2nd International Conference on Image, Vision and Computing (ICIVC) IEEE; 2017. p. 1011–1015.

Hodges, C., Moore, S., Lockee, B., Trust, T., & Bond, A. (2020). The Difference Between Emergency Remote Teaching and Online Learning, EDUCAUSE Review. https://er.educause.edu/articles/2020/3/the-difference-between-emergency-remote-teaching-and-online-learning?fbclid=IwAR0yiCtV1QE9bUgSjiBxK4JDhS0_ORoBpSs0o6gkju2zimYHc6jWSNfnE1M

Chapman, P., Clinton, J., Kerber, R., Khabaza, T., Reinartz, T., Shearer, C., Wirth, R.: CRIPS-DM 1.0 Step by Step Data Mining Guide. CRISP-DM Consortium (2000).

Saltan M., Terzi S., Ug E. Backcalculation of pavement layer moduli and Poisson’s ratio using data mining, Expert Syst. Appl., 38 (2011), pp. 2600-2608

Wirth, R., & Hipp, J., 2000. CRISP-DM: Towards a standard process model for data mining. In Proceedings of the 4th International Conference on the Practical Applications of knowledge discovery and data mining (pp. 29-39). Citeseer.

T.R. Sahama, P.R. Croll ‘A data warehouse architecture for clinical data warehousing’ L. Brankovic, P. Coddington, J.F. Roddick, C. Steketee, J.R. Warren, A. Wendelborn (Eds.), Proceedings of the 5th Australasian symposium on ACSW frontiers, Australian Computer Society, Inc., Darlinghurst, Australia, 68 (2007), pp. 227-232

Abdallah Moubayed, Mohammadnoor Injadat, Abdallah Shami & Hanan Lutfiyya (2020): Student Engagement Level in e-Learning Environment: Clustering Using K-means, American Journal of Distance Education,DOI: 10.1080/08923647.2020.1696140

Kovanovic´, V., Joksimovic´, S., Gasˇevic´, D., Owers, J., Scott, A. M., & Woodgate, A. (2016). Profiling MOOC course returners: How does student behavior change between two course enrollments?. InProceedings of the Third (2016) ACM Conference on Learning@ Scale (pp. 269–272). ACM.

Anderson, A., Huttenlocher, D., Kleinberg, J., & Leskovec, J. (2014). Engaging with massive online courses. In Proceedings of the 23rd International Conference on World Wide Web (pp. 687–698). ACM.

Kamath, A., Biswas, A., & Balasubramanian, V. (2016, Mar.). A crowdsourced approach to student engagement recognition in e-learning environments. In IEEE winter conference on applications of computer vision (wacv’16) (p. 1–9). doi: 10.1109/WACV.2016.7477618

Kuo, Y.-Y., J. Luo, and J. Brielmaier, (2015). “Investigating Students’ Use of Lecture Videos in Online Courses: A Case Study for Understanding Learning Behaviors via Data Mining”. International Conference on Web-Based Learning. 9412: 231-237.

Ghahramani, Z. (2004, September). Unsupervised learning. Retrieved from http://mlg.eng.cam.ac.uk/zoubin/papers/ul.pdf

S. Wang, M. Li, N. Hu, E. Zhu, J. Hu, X. Liu, J. Yin K-means

clustering with incomplete data IEEE Access, 7 (2019), pp. 69162-69171

MacQueen, J. (1967). Some methods for classification and analysis of multivariate observations. In Proceedings of the Berkeley Symposium on Mathematical Statistics and Probability, (pp. 281–297).

Raheela Asif, Agathe Merceron, Syed Abbas Ali, Najmi Ghani Haider, Analyzing undergraduate students' performance using educational data mining, Computers & Education, Volume 113, 2017, Pages 177-194, ISSN 0360-1315, https://doi.org/10.1016/j.compedu.2017.05.007.

Zakrzewska D. (2009) Cluster Analysis in Personalized E-Learning Systems. In: Nguyen N.T., Szczerbicki E. (eds) Intelligent Systems for Knowledge Management. Studies in Computational Intelligence, vol 252. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-04170-9_10.

Dash M., Liu H. (2000) Feature Selection for Clustering. In: Terano T., Liu H., Chen A.L.P. (eds) Knowledge Discovery and Data Mining. Current Issues and New Applications. PAKDD 2000. Lecture Notes in Computer Science, vol 1805. Springer, Berlin, Heidelberg. https://doi.org/10.1007/3-540-45571-X_13

Rousseeuw, P. J., Silhouettes: A graphical aid to the interpretation and validation of cluster analysis. Journal of Computational and Applied Mathematics, 20:53–65, 1987.

H. Li, C.-J. Li, X.-J. Wu, J. Sun, Statistics-based wrapper for feature selection: An implementation on financial distress identification with support vector machine, Appl. Soft Comput. 19 (2014) 57–67.

Cents-Boonstra, M., Lichtwarck-Aschoff, A., Denessen, E., Aelterman, N., & Haerens, L. (2020). Fostering student engagement with motivating teaching: an observation study of teacher and student behaviours. Research Papers in Education, 36(6),754–779. https://doi.org/10.1080/02671522.2020.176718




DOI: https://doi.org/10.47738/jads.v6i1.458

Refbacks

  • There are currently no refbacks.


Barcode

Journal of Applied Data Sciences

ISSN:2723-6471 (Online)
Publisher:Bright Publisher
Website:http://bright-journal.org/JADS
Email:taqwa@amikompurwokerto.ac.id (principal contact)
  support@bright-journal.org (technical issues)

This work is licensed under a Creative Commons Attribution-ShareAlike 4.0