A Fibonacci-Based Dynamic Neural Network Architecture for Imbalanced Classification of Higher Education Performance

Muhammad Ardiansyah Sembiring, Syahril Efendi, Mohammad Andri Budiman, T.Henny Febriana Harumy

Abstract


This study aims to address two problems in neural network design: the lack of a principled method for choosing hidden-layer neuron counts, and the reliability loss caused by severe class imbalance. To meet this objective, the study propose the Fibonacci Dynamic Neural Network, contributing, to our knowledge, the first architecture unifying number-theoretic hidden-layer sizing with imbalanced-learning correction, an unbiased selection property proven formally, and cross-domain validation. Conceptually, candidate hidden-layer widths are generated from the Fibonacci sequence: because consecutive terms grow proportionally toward the Golden Ratio, the resulting set spans a non-redundant, well-distributed range of capacities, unlike arbitrary sets from conventional methods. One candidate is drawn per layer via a discrete uniform distribution, giving every option equal selection probability, while class imbalance is corrected through synthetic minority oversampling applied only to training data. The architecture was evaluated experimentally on three benchmark datasets spanning higher education, credit card fraud, and charitable donation prediction, with imbalance ratios from about eighteen-to-one to nearly five hundred eighty-to-one, tested across five seeds against five baselines and an ablation study via the Wilcoxon signed-rank test. It achieved macro F1-scores of approximately 0.83, 0.94, and 0.81, improvements of sixteen, five, and sixteen percent over the strongest baseline, with the smallest training-test performance gap of any model tested; oversampling and Fibonacci spacing contributed most to these gains. These findings suggest number-theoretic structures offer a practical, reproducible basis for architecture design under class imbalance, useful for future work on automated range selection and for deploying reliable classifiers in imbalanced real-world settings.


Keywords


Fibonacci Sequence; Dynamic Neural Network; Imbalanced Classification; Discrete Uniform Distribution; SMOTE; Hidden Layer Optimization; Artificial Neural Network; Multi-Class Classification

Full Text:

PDF

References


N. V. Chawla, K. W. Bowyer, L. O. Hall, and W. P. Kegelmeyer, "SMOTE: Synthetic Minority Over-sampling Technique," J. Artif. Intell. Res., vol. 16, pp. 321–357, 2002, doi: 10.1613/jair.953.

M. A. Sembiring, H. Saputra, R. A. Yusda, S. Sutarman, and E. B. Nababan, "Performance of Robust Support Vector Machine Classification Model on Balanced, Imbalanced and Outliers Datasets," JITK (J. Ilmu Pengetah. dan Teknol. Komput.), 2024.

M. G. M. Abdolrasol, S. M. S. Hussain, T. S. Ustun, M. R. Sarker, M. A. Hannan, R. Mohamed, J. A. Ali, S. Mekhilef, and A. Milad, "Artificial neural networks based optimization techniques: A review," Electronics, vol. 10, no. 21, p. 2689, 2021, doi: 10.3390/electronics10212689.

Y. Han, G. Huang, S. Song, L. Yang, H. Wang, and Y. Wang, "Dynamic Neural Networks: A Survey," IEEE Trans. Pattern Anal. Mach. Intell., vol. 44, no. 11, pp. 7436–7456, 2022, doi: 10.1109/TPAMI.2021.3117837.

P. R. Verma, N. P. Singh, D. Pantola, and X. Cheng, "Neural network developments: A detailed survey from static to dynamic models," Comput. Electr. Eng., vol. 120, p. 109710, 2024, doi: 10.1016/j.compeleceng.2024.109710.

K. Moshkbar-Bakhshayesh, "Identification of the appropriate architecture of multilayer feed-forward neural network for estimation of NPPs parameters using the GA in combination with the LM and the BR algorithms," Ann. Nucl. Energy, vol. 147, p. 107670, 2020, doi: 10.1016/j.anucene.2020.107670.

F. Oduol and I. O. Okoth, "On Generalized Fibonacci Numbers," Commun. Adv. Math. Sci., vol. 3, no. 4, pp. 186–202, 2020, doi: 10.33434/cams.771023.

L. Alzubaidi, J. Zhang, A. J. Humaidi, A. Al-Dujaili, Y. Duan, O. Al-Shamma, J. Santamaría, M. A. Fadhel, M. Al-Amidie, and L. Farhan, "Review of deep learning: concepts, CNN architectures, challenges, applications, future directions," J. Big Data, vol. 8, no. 1, p. 53, 2021, doi: 10.1186/s40537-021-00444-8.

K. Yotov and E. Hadzhikolev, "Finding the Optimal Topology of an Approximating Neural Network," Mathematics, vol. 11, no. 1, p. 217, 2023, doi: 10.3390/math11010217.

P. Mougkogiannis and A. Adamatzky, "On the Response of Proteinoid Ensembles to Fibonacci Sequences," ACS Omega, 2025, doi: 10.1021/acsomega.4c10571.

R. Jain, N. Jain, A. Aggarwal, and D. J. Hemanth, "Convolutional neural network based Alzheimer's disease classification from magnetic resonance brain images," Cogn. Syst. Res., vol. 57, pp. 147–159, 2019, doi: 10.1016/j.cogsys.2018.12.015.

T. Hattiya, K. Dittakan, and S. Musikasuwan, "Diabetic Retinopathy Detection using Convolutional Neural Network: A Comparative Study on Different Architectures," Eng. Access, vol. 7, no. 1, pp. 57–64, 2021.

H. Chen, L. Geng, H. Zhao, C. Zhao, and A. Liu, "Image recognition algorithm based on artificial intelligence," Neural Comput. Appl., vol. 34, no. 9, pp. 6661–6672, 2022, doi: 10.1007/s00521-021-06777-4.

N. Srivastava, G. Hinton, A. Krizhevsky, I. Sutskever, and R. Salakhutdinov, "Dropout: A Simple Way to Prevent Neural Networks from Overfitting," J. Mach. Learn. Res., vol. 15, no. 1, pp. 1929–1958, 2014. [Online]. Available: https://jmlr.org/papers/v15/srivastava14a.html

G. R. Yang and X. J. Wang, "Artificial Neural Networks for Neuroscientists: A Primer," Neuron, vol. 107, no. 6, pp. 1048–1070, 2020, doi: 10.1016/j.neuron.2020.09.005.

M. Adil, R. Ullah, S. Noor, and N. Gohar, "Effect of number of neurons and layers in an artificial neural network for generalized concrete mix design," Neural Comput. Appl., vol. 34, no. 11, pp. 8355–8363, 2022, doi: 10.1007/s00521-020-05305-8.

M. M. Taye, "Understanding of Machine Learning with Deep Learning: Architectures, Workflow, Applications and Future Directions," Computers, vol. 12, no. 5, p. 91, 2023, doi: 10.3390/computers12050091.

D.-H. Lee, S.-R. Lee, and K. Lee, "Shallow Landslide Susceptibility Models Based on Artificial Neural Networks Considering the Factor Selection Method and Various Non-Linear Activation Functions," Remote Sens., vol. 12, no. 7, p. 1194, 2020, doi: 10.3390/rs12071194.

F. Saberi-Movahed, M. Najafzadeh, and A. Mehrpooya, "Receiving More Accurate Predictions for Longitudinal Dispersion Coefficients in Water Pipelines: Training Group Method of Data Handling Using Extreme Learning Machines," Eng. Appl. Comput. Fluid Mech., vol. 14, no. 1, pp. 892–912, 2020, doi: 10.1080/19942060.2020.1786232.

S. Somprom, W. Nimnual, and W. Hongthong, "Some Identities for an Alternating Sum of Fibonacci and Lucas Numbers of Order k," WSEAS Trans. Math., vol. 21, pp. 580–584, 2022, doi: 10.37394/23206.2022.21.68.

K. Du, C. Leung, W. H. Mow, and M. N. S. Swamy, "Perceptron: Learning, Generalization, Model Selection, Fault Tolerance, and Role in the Deep Learning Era," Mathematics, vol. 10, no. 24, p. 4730, 2022, doi: 10.3390/math10244730.

D. P. Kingma and J. L. Ba, "Adam: A Method for Stochastic Optimization," in Proc. 3rd Int. Conf. Learn. Represent. (ICLR 2015), 2015. [Online]. Available: https://arxiv.org/abs/1412.6980

J. Ma and J. Tang, "A review for dynamics in neuron and neuronal network," Nonlinear Dyn., vol. 89, no. 3, pp. 1569–1578, 2017, doi: 10.1007/s11071-017-3565-3.

W. Yuliatmojo and A. A. Saputri, "Implementasi Sistem Informasi Laman Sinta Dalam Meningkatkan Manajemen Publikasi Ilmiah," J. Ris. Rumpun Ilmu Sos. Polit. dan Hum., vol. 3, no. 1, pp. 10–21, 2024, doi: 10.55606/jurrish.v3i1.2383.

M. A. Ali, A. Elsayed, I. Elkabani, M. Akrami, M. E. Youssef, and G. E. Hassan, "Optimizing Artificial Neural Networks for the Accurate Prediction of Global Solar Radiation: A Performance Comparison of Different Neural Network Architectures," Int. J. Photoenergy, vol. 2023, 2023, doi: 10.1155/2023/4795824.




DOI: https://doi.org/10.47738/jads.v7i4.1459

Refbacks

  • There are currently no refbacks.



Barcode

Journal of Applied Data Sciences

ISSN:2723-6471 (Online)
Publisher:Bright Publisher
Website:http://bright-journal.org/JADS
Email:taqwa@amikompurwokerto.ac.id (principal contact)
  support@bright-journal.org (technical issues)

This work is licensed under a Creative Commons Attribution-ShareAlike 4.0