Novel Predictive Framework for Student Learning Styles Based on Felder-Silverman and Machine Learning Model

Wiga Maulana Baihaqi, Rujianto Eko Saputro, Fandy Setyo Utomo, Sarmini Sarmini

Abstract


This study analyzes data from the Open University Learning Analytics Dataset to evaluate how students' interactions with Virtual Learning Environment (VLE) materials influence their final outcomes. This research aims to formulate and build a novel predictive framework based on the Felder-Silverman and Machine Learning Model for student learning styles. Based on these objectives, this research provides novelty and contributions since it enhances student data analysis, uses a learning model using Felder-Silverman Learning Style Model (FSLSM) to give a more comprehensive understanding of students' learning styles, and improves prediction accuracy by introducing Artificial Neural Network (ANN) and feature selection using Random Forest. The data used includes 3 main files: vle.csv, which contains information about the materials and activities in the VLE; studentVle.csv, which records students' interactions with the materials; and studentInfo.csv, which provides demographic information of students and their final outcomes. The analysis process involved data merging and processing, including handling of missing values, data type conversion, as well as mapping activity types to learning style features based on the FSLSM. We use the Random Forest feature selection method, as well as data imbalance handling techniques such as oversampling, to improve model performance. The applied classification models include Logistic Regression, K-Nearest Neighbor, Random Forest, Support Vector Machine (SVM), and ANN. The analysis results showed that after tuning, the Random Forest model achieved 97% accuracy, while SVM achieved 97% accuracy as well, with better performance than previous studies. This research highlights the importance of comprehensive data integration and appropriate processing techniques in improving the accuracy of student learning style prediction. Based on the increase in accuracy results, it can be beneficial for more effective personalized learning and improve our understanding of students' learning style preferences. The research advances knowledge and provides practical applications for educators to tailor their teaching strategies.

Keywords


Open University Learning Analytics Dataset (OULAD); Virtual Learning Environment (VLE); Felder-Silverman Learning Style Model (FSLSM); Random Forest; K-Nearest Neighbor (KNN); Support Vector Machine (SVM); Artificial Neural Network (ANN); Data Analysis; F

Full Text:

PDF

References


A. T. Quadri and N. A. Shukor, “The Benefits of Learning Analytics to Higher Education Institutions: A Scoping Review,” Int. J. Emerg. Technol. Learn., vol. 16, no. 23, pp. 4–15, 2021, doi: 10.3991/ijet.v16i23.27471. https://online-journals.org/index.php/i-jet/article/view/27471/10379

S. Septiani, S. Eko, J. Sutarto, and C. B. Utomo, “Students and Artificial Intelligence,” pp. 691–697, 2023. https://proceeding.unnes.ac.id/ISET/article/view/2497/1984

Y. S. Mian, F. Khalid, A. W. C. Qun, and S. S. Ismail, “Learning Analytics in Education, Advantages and Issues: A Systematic Literature Review,” Creat. Educ., vol. 13, no. 09, pp. 2913–2920, 2022, doi: 10.4236/ce.2022.139183. https://www.scirp.org/pdf/ce_2022092216060283.pdf

M. Yin, H. Cao, Z. Yu, and X. Pan, “Manual Label and Machine Learning in Clustering and Predicting Student Performance: A Practice Based on Web-Interactive Teaching Systems,” Int. J. Web-Based Learn. Teach. Technol., vol. 19, no. 1, pp. 1–33, 2024, doi: 10.4018/IJWLTT.347661. https://www.igi-global.com/pdf.aspx?tid=347661&ptid=333252&ctid=4&oa=true&isxn=9798369324585

H. Waheed, S.-U. Hassan, N. R. Aljohani, J. Hardman, S. Alelyani, and R. Nawaz, “Predicting academic performance of students from VLE big data using deep learning models,” Comput. Human Behav., vol. 104, p. 106189, 2020, doi: https://doi.org/10.1016/j.chb.2019.106189.

https://www.sciencedirect.com/science/article/abs/pii/S0747563219304017?via%3Dihub

R. Qasrawi, S. P. V. Polo, D. A. Al-Halawa, S. Hallaq, and Z. Abdeen, “Assessment and Prediction of Depression and Anxiety Risk Factors in Schoolchildren: Machine Learning Techniques Performance Analysis,” JMIR Form. Res., vol. 6, no. 8, pp. 1–15, 2022, doi: 10.2196/32736.

https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9475423/pdf/formative_v6i8e32736.pdf

W. Admiraal, J. Vermeulen, and J. Bulterman-Bos, “Teaching with learning analytics:how to connect computer-based assessment data with classroom instruction?,” Technol. Pedagog. Educ., vol. 29, no. 5, pp. 577–591, 2020, doi: 10.1080/1475939X.2020.1825992.

https://www.tandfonline.com/doi/epdf/10.1080/1475939X.2020.1825992?needAccess=true

R. Brungel, J. Ruckert, and C. M. Friedrich, “Project-Based Learning in a Machine Learning Course with Differentiated Industrial Projects for Various Computer Science Master Programs,” 2020 IEEE 32nd Conf. Softw. Eng. Educ. Training, CSEE T 2020, no. Ml, pp. 50–54, 2020, doi: 10.1109/CSEET49119.2020.9206229. Link : https://sci-hub.se/https://ieeexplore.ieee.org/document/9206229

K. L. M. Ang, F. L. Ge, and K. P. Seng, “Big Educational Data Analytics: Survey, Architecture and Challenges,” IEEE Access, vol. 8, pp. 116392–116414, 2020, doi: 10.1109/ACCESS.2020.2994561. https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=9093868

M. I. I. bin Zainuddin and H. Mohamad Judi, “Designing and Incorporating Personalized Learning Analytics: Examining Self-Regulated Meaningful Learning,” Int. J. Acad. Res. Bus. Soc. Sci., vol. 11, no. 12, pp. 2276–2287, 2021, doi: 10.6007/ijarbss/v11-i12/11327.

https://hrmars.com/index.php/IJAREMS/article/view/11327/Designing-and-Incorporating-Personalized-Learning-Analytics-Examining-Self-Regulated-Meaningful-Learning

T. Mukherjee, “Improving Data Quality for Educational Data Mining (EDM) for Indian Ed-Tech Start-Ups,” Int. J. Sci. Eng. Manag., vol. 9, no. 8, pp. 32–33, 2022, doi: 10.36647/ijsem/09.08.a005. https://www.technoarete.org/common_abstract/pdf/IJSEM/v9/i8/Ext_52347.pdf

A. Rashad Sayed, M. Helmy Khafagy, M. Ali, and M. Hussien Mohamed, “Predict student learning styles and suitable assessment methods using click stream,” Egypt. Informatics J., vol. 26, no. April, p. 100469, 2024, doi: 10.1016/j.eij.2024.100469. https://www.researchgate.net/publication/379478419_Predict_student_learning_styles_and_suitable_assessment_methods_using_click_stream

D. Niu, K. Wang, L. Sun, J. Wu, and X. Xu, “Short-term photovoltaic power generation forecasting based on random forest feature selection and CEEMD: A case study,” Appl. Soft Comput. J., vol. 93, p. 106389, 2020, doi: 10.1016/j.asoc.2020.106389.

https://sci-hub.se/https://www.sciencedirect.com/science/article/abs/pii/S156849462030329X

X. K. Li, W. Chen, Q. Zhang, and L. Wu, “Building Auto-Encoder Intrusion Detection System based on random forest feature selection,” Comput. Secur., vol. 95, p. 101851, 2020, doi: 10.1016/j.cose.2020.101851. https://sci-hub.se/https://www.sciencedirect.com/science/article/abs/pii/S0167404820301231

W. Huo, W. Li, Z. Zhang, C. Sun, F. Zhou, and G. Gong, “Performance prediction of proton-exchange membrane fuel cell based on convolutional neural network and random forest feature selection,” Energy Convers. Manag., vol. 243, no. June, p. 114367, 2021, doi: 10.1016/j.enconman.2021.114367. https://sci-hub.se/10.1016/j.enconman.2021.114367

O. Oladipupo and S. Samuel, “A Learning Analytic Approach to Modelling Student-Staff Interaction From Students’ Perception of Engagement Practices,” IEEE Access, vol. 12, no. December 2023, pp. 10315–10333, 2024, doi: 10.1109/ACCESS.2024.3352440.

https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=10387667

Enitan Shukurat Animashaun, Babajide Tolulope Familoni, and Nneamaka Chisom Onyebuchi, “Advanced machine learning techniques for personalising technology education,” Comput. Sci. IT Res. J., vol. 5, no. 6, pp. 1300–1313, 2024, doi: 10.51594/csitrj.v5i6.1198. https://www.fepbl.com/index.php/csitrj/article/view/1198

A. R. Masegosa, R. Cabañas, A. D. Maldonado, and M. Morales, “Learning Styles Impact Students’ Perceptions on Active Learning Methodologies: A Case Study on the Use of Live Coding and Short Programming Exercises,” Educ. Sci., vol. 14, no. 3, 2024, doi: 10.3390/educsci14030250. https://www.mdpi.com/2227-7102/14/3/250

R. D. Mahande and N. M. Abdal, “A HyFlex learning measurement model based on students’ cognitive learning styles to create equitable learning,” World J. Educ. Technol. Curr. Issues, vol. 14, no. 5, pp. 1469–1481, 2022, doi: 10.18844/wjet.v14i5.7777. https://un-pub.eu/ojs/index.php/wjet/article/view/7777

M. Haviz, I. M. Maris, E. Nasrul, D. Azis, and L. Lufri, “The Learning Styles of Prospective Biology Teachers at Islamic University in Indonesia,” Pedagogika, vol. 149, no. 1, pp. 238–256, 2023, doi: 10.15823/p.2023.149.11. https://ejournals.vdu.lt/index.php/Pedagogika/article/view/3310/2721

S. Ren, “Optimization of English Classroom Interaction Models Incorporating Machine Learning,” J. Electr. Syst., vol. 20, no. 6s, pp. 1669–1681, 2024, doi: 10.52783/jes.3086. https://journal.esrgroups.org/jes/article/view/3086/2421

M. S. Hasibuan, R. Z. Abdul Aziz, D. A. Dewi, T. B. Kurniawan, and N. A. Syafira, “Recommendation Model for Learning Material Using the Felder Silverman Learning Style Approach,” HighTech Innov. J., vol. 4, no. 4, pp. 811–820, 2023, doi: 10.28991/HIJ-2023-04-04-010. https://www.researchgate.net/publication/322947447_Learning_style_model_detection_based_on_prior_knowledge_in_e-learning_system

I. Azzi, A. Radouane, L. Laaouina, A. Jeghal, A. Yahyaouy, and H. Tairi, “Fuzzy Classification Approach to Select Learning Objects Based on Learning Styles in Intelligent E-Learning Systems,” Informatics, vol. 11, no. 2, 2024, doi: 10.3390/informatics11020029. https://www.mdpi.com/2227-9709/11/2/29

L. Zhao, J. Ren, L. Zhang, and H. Zhao, “Quantitative Analysis and Prediction of Academic Performance of Students Using Machine Learning,” Sustain., vol. 15, no. 16, 2023, doi: 10.3390/su151612531. https://www.mdpi.com/2071-1050/15/16/12531

S Sukanya and Dr D William Albert, “A Novel Approach to Predict Students Performance through Machine Learning,” Int. J. Eng. Technol. Manag. Sci., vol. 7, no. 5, pp. 278–283, 2023, doi: 10.46647/ijetms.2023.v07i05.032. https://ijetms.in/Vol-7-issue-5/Vol-7-Issue-5-32.pdf

R. Nazempour and H. Darabi, “Personalized Learning in Virtual Learning Environments Using Students’ Behavior Analysis,” Educ. Sci., vol. 13, no. 5, 2023, doi: 10.3390/educsci13050457. https://www.mdpi.com/2227-7102/13/5/457

C. Gai, “The Exploration of Modelling for The Student Achievement Predictor,” Highlights Sci. Eng. Technol., vol. 81, pp. 132–142, 2024, doi: 10.54097/skhacg41. https://drpress.org/ojs/index.php/HSET/article/view/15927

W. WAAM and P. HKS, “Identifying the Learning Style of Students Using Machine Learning Techniques: An Approach of Felder Silverman Learning Style Model (FSLSM),” Asian J. Res. Comput. Sci., vol. 17, no. 3, pp. 15–37, 2024, doi: 10.9734/ajrcos/2024/v17i3422.

https://journalajrcos.com/index.php/AJRCOS/article/view/422/835

“OU Analyse | Knowledge Media Institute | The Open University.” Accessed: Oct. 07, 2024. [Online]. Available: https://analyse.kmi.open.ac.uk/open_dataset

H. Mohammedqasim, A. A. Jasim, R. Mohammedqasem, and O. Ata, “Enhancing Predictive Performance in Covid-19 Healthcare Datasets: a Case Study Based on Hyper Adasyn Over-Sampling and Genetic Feature Selection,” J. Eng. Sci. Technol., vol. 19, no. 2, pp. 598–617, 2024. https://jestec.taylors.edu.my/Vol%2019%20Issue%202%20April%202024/19_2_19.pdf

A. Krajah, Y. F. Almadani, H. Saadeh, and A. Sleit, “Analyzing Covid-19 Data Using Various Algorithms,” 2021 IEEE Jordan Int. Jt. Conf. Electr. Eng. Inf. Technol. JEEIT 2021 - Proc., pp. 66–71, 2021, doi: 10.1109/JEEIT53412.2021.9634124. https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=9634124

F. Yang, K. Wang, L. Sun, M. Zhai, J. Song, and H. Wang, “A hybrid sampling algorithm combining synthetic minority over-sampling technique and edited nearest neighbor for missed abortion diagnosis,” BMC Med. Inform. Decis. Mak., vol. 22, no. 1, pp. 1–14, 2022, doi: 10.1186/s12911-022-02075-2. https://bmcmedinformdecismak.biomedcentral.com/articles/10.1186/s12911-022-02075-2

M. Binkhonain and L. Zhao, “A review of machine learning algorithms for identification and classification of non-functional requirements,” Expert Syst. with Appl. X, vol. 1, 2019, doi: 10.1016/j.eswax.2019.100001. https://www.sciencedirect.com/science/article/pii/S2590188519300010




DOI: https://doi.org/10.47738/jads.v5i4.408

Refbacks

  • There are currently no refbacks.



Barcode

Journal of Applied Data Sciences

ISSN:2723-6471 (Online)
Publisher:Bright Publisher
Website:http://bright-journal.org/JADS
Email:taqwa@amikompurwokerto.ac.id (principal contact)
  support@bright-journal.org (technical issues)

This work is licensed under a Creative Commons Attribution-ShareAlike 4.0