.png)
An Effective Hybrid Approach for Predicting and Optimizing Business Complexity Metrics and Data Insights
Abstract
This study proposes a hybrid approach for optimizing complexity prediction in the domain of business intelligence by integrating three powerful techniques: the Multi-Objective Complexity Prediction Model (MPK), Principal Component Analysis (PCA), and the XGBoost regression algorithm. The MPK model serves as a state-based simulator to capture system complexity dynamics, while PCA is employed to reduce data dimensionality and eliminate redundancy among features. Subsequently, XGBoost is used as a non-linear predictive model to estimate complexity values based on the refined input features. The results show that this hybrid approach significantly improves prediction accuracy, reduces data noise, and streamlines the modelling process. Quantitative evaluation using Mean Squared Error (MSE), Mean Absolute Error (MAE), and the R-squared (R²) metric demonstrates exceptional performance, with an MAE of 0.000035, an MSE of 6.7 × 10⁻⁹, and an R² of 0.9999999. These results confirm that the integration of MPK, PCA, and XGBoost is highly effective for complexity prediction tasks and can provide accurate and insightful outcomes in business intelligence analytics.
Keywords
Full Text:
PDFReferences
. Y. Niu, L. Ying, J. Yang, M. Bao, and C. B. Sivaparthipan, “Organizational business intelligence and decision making using big data analytics,” Inf Process Manag, vol. 58, no. 6, p. 102725, Nov. 2021, doi: 10.1016/j.ipm.2021.102725.
. S. Yerpude, “Business Intelligence and Its Impact on Decision Making,” 2023, pp. 209–223. doi: 10.1108/S1569-37592023000111C014.
. Z. F. H. Aladwani, A. Hamdan, and M. Kanan, “The Impact of Business Intelligence Systems on Decision Making,” 2024, pp. 181–190. doi: 10.1007/978-3-031-62102-4_15.
. D. A. Otchere, T. O. Arbi Ganat, R. Gholami, and S. Ridha, “Application of supervised machine learning paradigms in the prediction of petroleum reservoir properties: Comparative analysis of ANN and SVM models,” J Pet Sci Eng, vol. 200, p. 108182, May 2021, doi: 10.1016/j.petrol.2020.108182.
. S. Ghimire, T. Nguyen-Huy, R. C. Deo, D. Casillas-Pérez, and S. Salcedo-Sanz, “Efficient daily solar radiation prediction with deep learning 4-phase convolutional neural network, dual stage stacked regression and support vector machine CNN-REGST hybrid model,” Sustainable Materials and Technologies, vol. 32, p. e00429, Jul. 2022, doi: 10.1016/j.susmat.2022.e00429.
. A. Aldoseri, K. N. Al-Khalifa, and A. M. Hamouda, “Re-Thinking Data Strategy and Integration for Artificial Intelligence: Concepts, Opportunities, and Challenges,” Applied Sciences, vol. 13, no. 12, p. 7082, Jun. 2023, doi: 10.3390/app13127082.
. A. Aljohani, “Predictive Analytics and Machine Learning for Real-Time Supply Chain Risk Mitigation and Agility,” Sustainability, vol. 15, no. 20, p. 15088, Oct. 2023, doi: 10.3390/su152015088.
. Y. Niu, L. Ying, J. Yang, M. Bao, and C. B. Sivaparthipan, “Organizational business intelligence and decision making using big data analytics,” Inf Process Manag, vol. 58, no. 6, p. 102725, Nov. 2021, doi: 10.1016/j.ipm.2021.102725.
. M. H. Alavidoost, A. Jafarnejad, and H. Babazadeh, “A novel fuzzy mathematical model for an integrated supply chain planning using multi-objective evolutionary algorithm,” Soft comput, vol. 25, no. 3, pp. 1777–1801, Feb. 2021, doi: 10.1007/s00500-020-05251-6.
. T. Kurita, “Principal Component Analysis (PCA),” in Computer Vision, Cham: Springer International Publishing, 2021, pp. 1013–1016. doi: 10.1007/978-3-030-63416-2_649.
. C. Bentéjac, A. Csörgő, and G. Martínez-Muñoz, “A comparative analysis of gradient boosting algorithms,” Artif Intell Rev, vol. 54, no. 3, pp. 1937–1967, Mar. 2021, doi: 10.1007/s10462-020-09896-5.
. S. Bandyopadhyay, S. S. Thakur, and J. K. Mandal, “Product recommendation for e-commerce business by applying principal component analysis (PCA) and K-means clustering: benefit for the society,” Innov Syst Softw Eng, vol. 17, no. 1, pp. 45–52, Mar. 2021, doi: 10.1007/s11334-020-00372-5.
. P. Zhang, Y. Jia, and Y. Shang, “Research and application of XGBoost in imbalanced data,” Int J Distrib Sens Netw, vol. 18, no. 6, p. 155013292211069, Jun. 2022, doi: 10.1177/15501329221106935.
. C.-C. Tsui, Robust Control System Design. Boca Raton: CRC Press, 2022. doi: 10.1201/9781003259572.
. W. G. Y. Tan, M. Xiao, and Z. Wu, “Robust reduced-order machine learning modeling of high-dimensional nonlinear processes using noisy data,” Digital Chemical Engineering, vol. 11, p. 100145, Jun. 2024, doi: 10.1016/j.dche.2024.100145.
. W. Dong, M. Woźniak, J. Wu, W. Li, and Z. Bai, “Denoising Aggregation of Graph Neural Networks by Using Principal Component Analysis,” IEEE Trans Industr Inform, vol. 19, no. 3, pp. 2385–2394, Mar. 2023, doi: 10.1109/TII.2022.3156658.
. Y. Zou, C. Gao, and H. Gao, “Business Failure Prediction Based on a Cost-Sensitive Extreme Gradient Boosting Machine,” IEEE Access, vol. 10, pp. 42623–42639, 2022, doi: 10.1109/ACCESS.2022.3168857.
. T. O. Hodson, T. M. Over, and S. S. Foks, “Mean Squared Error, Deconstructed,” J Adv Model Earth Syst, vol. 13, no. 12, Dec. 2021, doi: 10.1029/2021MS002681.
. P. K. Ozili, “The Acceptable R-Square in Empirical Modelling for Social Science Research,” 2023, pp. 134–143. doi: 10.4018/978-1-6684-6859-3.ch009.
. D. Chicco, M. J. Warrens, and G. Jurman, “The coefficient of determination R-squared is more informative than SMAPE, MAE, MAPE, MSE and RMSE in regression analysis evaluation,” PeerJ Comput Sci, vol. 7, p. e623, Jul. 2021, doi: 10.7717/peerj-cs.623.
. Z. Wang, W. G. Y. Tan, G. P. Rangaiah, and Z. Wu, “Machine learning aided model predictive control with multi-objective optimization and multi-criteria decision making,” Comput Chem Eng, vol. 179, p. 108414, Nov. 2023, doi: 10.1016/j.compchemeng.2023.108414.
. R. B. Y. Syah, H. Satria, M. Elveny, and M. K. M. Nasution, “Complexity prediction model: a model for multi-object complexity in consideration to business uncertainty problems,” Bulletin of Electrical Engineering and Informatics, vol. 12, no. 6, pp. 3697–3705, Dec. 2023, doi: 10.11591/eei.v12i6.5380.
. P. Ray, S. S. Reddy, and T. Banerjee, “Various dimension reduction techniques for high dimensional data analysis: a review,” Artif Intell Rev, vol. 54, no. 5, pp. 3473–3515, Jun. 2021, doi: 10.1007/s10462-020-09928-0.
. M. Greenacre, P. J. F. Groenen, T. Hastie, A. I. D’Enza, A. Markos, and E. Tuzhilina, “Principal component analysis,” Nature Reviews Methods Primers, vol. 2, no. 1, p. 100, Dec. 2022, doi: 10.1038/s43586-022-00184-w.
. S. Hakkal and A. A. Lahcen, “XGBoost To Enhance Learner Performance Prediction,” Computers and Education: Artificial Intelligence, vol. 7, p. 100254, Dec. 2024, doi: 10.1016/j.caeai.2024.100254.
. T. Ozcan and E. P. Ozmen, “Prediction of Heart Disease Using a Hybrid XGBoost-GA Algorithm with Principal Component Analysis: A Real Case Study,” International Journal on Artificial Intelligence Tools, vol. 32, no. 02, Mar. 2023, doi: 10.1142/S0218213023400092.
. D. S. K. Karunasingha, “Root mean square error or mean absolute error? Use their ratio as well,” Inf Sci (N Y), vol. 585, pp. 609–629, Mar. 2022, doi: 10.1016/j.ins.2021.11.036.
. M. Elveny, M. K. M. Nasution, F. Purnamasari, and T. S. M. T. Wook, “Blockchain-Enabled KYC Integration for CLV Optimization with Robust M-Estimation and IRLS Method,” ICT Express, Mar. 2025, doi: 10.1016/j.icte.2025.03.006.
. N. Pekin Alakoc and H. Mhalla, “A Heuristic Approach for Solving Robotic Assembly Line Balancing Problems,” Engineering, Technology & Applied Science Research, vol. 15, no. 2, pp. 20912–20918, Apr. 2025, doi: 10.48084/etasr.9845
DOI: https://doi.org/10.47738/jads.v6i3.830
Refbacks
- There are currently no refbacks.
Journal of Applied Data Sciences
| ISSN | : | 2723-6471 (Online) |
| Publisher | : | Bright Publisher |
| Website | : | http://bright-journal.org/JADS |
| : | taqwa@amikompurwokerto.ac.id (principal contact) | |
| support@bright-journal.org (technical issues) |
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0