.png)
A Comparative Study of Feature Selection Techniques in Machine Learning for Predicting Stock Market Trends
Abstract
This study aims to compare the effectiveness of three feature selection techniques, namely Principal Component Analysis (PCA), Information Gain (IG), and Recursive Feature Elimination (RFE), in predicting stock market conditions. This research uses three distinct Kaggle datasets that contain data for predicting stock market values. The results show that RFE performs better than PCA and IG in predicting market value with fairly precise accuracy. By using the RFE technique, this study was able to identify the most influential features in prediction, reduce the dimensionality of the data, and improve the performance of the prediction model. These provide significant benefits in the world of stocks, including improved investment decisions, reduced investment risk, improved trading strategy performance, and identification of promising investment opportunities. For future research, further comparative studies between other feature selection techniques can be conducted. This research has novelty in several aspects. First, it applies different feature selection techniques, namely Principal Component Analysis (PCA), Information Gain (IG), and Recursive Feature Elimination (RFE), in the context of stock market prediction. Utilizing these techniques to select the most relevant features in predicting stock market conditions provides a deeper understanding of the influence of these features on stock price movements. Furthermore, this research utilizes different datasets from Kaggle, which represent various stock market value predictions. The utilization of diverse datasets provides variation in the data and allows this research to examine the performance of feature selection techniques in multiple stock market contexts. In conclusion, this research provides insight into the effectiveness of feature selection techniques in stock market value prediction. It also provides actionable guidance for market participants to improve investment decisions and trading performance in the stock market.
Full Text:
PDFReferences
.Wang, "Research on the selection of stock prediction model features for long-term stock market trends based on K-nearest neighbor algorithms," inProceedings - 2022 International Conference on Data Analytics, Computing and Artificial Intelligence, ICDACAI 2022, 2022, pp. 38-42. doi: 10.1109/ICDACAI57211.2022.00015.
.Goyal, J. S. Challa, S. Shrivastava, and N. Goyal, "Anytime Frequent Itemset Mining of Transactional Data Streams,"Big Data Res., vol. 21, p. 100146, 2020, doi: https://doi.org/10.1016/j.bdr.2020.100146.
.Araújo, A. Pereira, and F. Benevenuto, "A comparative study of machine translation for multilingual sentence-level sentiment analysis,"Inf. Sci. (Ny)., vol. 512, pp. 1078-1102, 2020, doi: 10.1016/j.ins.2019.10.031.
[. Park and J. Kwon Bae, "Using machine learning algorithms for housing price prediction: The case of Fairfax County, Virginia housing data,"Expert Syst. Appl., vol. 42, no. 6, pp. 2928-2934, 2015, doi: 10.1016/j.eswa.2014.11.040.
.Aslam, K. S. Mughal, A. Ali, and Y. T. Mohmand, "Forecasting Islamic securities index using artificial neural networks: performance evaluation of technical indicators,"J. Econ. Adm. Sci., vol. 37, no. 2, pp. 253-271, Jan. 2021, doi: 10.1108/JEAS-04-2020-0038.
. Figueira, "Predicting grades by principal component analysis: A data mining approach to learning analytics,"Proc. - IEEE 16th Int. Conf. Adv. Learn. Technol. ICALT 2016, pp. 465-467, 2016, doi: 10.1109/ICALT.2016.103.
.Dohertyet al., "A comparison of feature selection methodologies and learning algorithms in the development of a DNA methylation-based telomere length estimator," BMC Bioinformatics, vol. 24, no. 1, 2023, doi: 10.1186/s12859-023-05282-4.
.Ahmadi, A. Garcia-Arce, D. T. Masel, E. Reich, J. Puckey, and R. Maff, "A metaheuristic-based stacking model for predicting the risk of patient no-show and late cancellation for neurology appointments,"IISE Trans. Healthc. Syst. Eng., vol. 9, no. 3, pp. 272-291, 2019, doi: 10.1080/24725579.2019.1649764.
. Bertolini, S. J. Finch, and R. H. Nehm, "Quantifying variability in predictions of student performance: Examining the impact of bootstrap resampling in data pipelines,"Comput. Educ. Artif. Intell., vol. 3, p. 100067, 2022, doi: https://doi.org/10.1016/j.caeai.2022.100067.
. N. Chi, "Modeling and Forecasting Long-Term Records of Mean Sea Level at Grand Isle, Louisiana: SARIMA, NARNN, and Mixed SARIMA-NARNN Models,"J. Appl. Data Sci., vol. 2, no. 2, pp. 1-13, 2021, doi: 10.47738/jads.v2i2.27.
.Wahyuningsih, "Problems, Challenges, and Opportunities of Visualization on Big Data,"J. Appl. Data Sci., vol. 1, no. 1, pp. 20-28, 2020, doi: 10.47738/jads.v1i1.8.
.An, "Research on Short Video Publishing Algorithm and Recommendation Mechanism Based on Artificial Intelligence,"J. Appl. Data Sci., vol. 3, no. 2, pp. 66-71, 2022, doi: 10.47738/jads.v3i2.59.
.Ran, "Development of Computer Intelligent Control System Based on Modbus and WEB Technology,"J. Appl. Data Sci., vol. 4, no. 1, pp. 15-21, 2023, doi: 10.47738/jads.v4i1.75.
.Kaya and T. Dumitras, "When Does Data Augmentation Help With Membership Inference Attacks?,"Int. Conf. Mach. Learn., pp. 5345-5355, 2021, [Online]. Available: https://www.scopus.com/inward/record.uri?eid=2-s2.0-85119153762&partnerID=40&md5=4362f9edad0a26989c218cefb1d4c669
. Bayer, M.-A. Kaufhold, B. Buchhold, M. Keller, J. Dallmeyer, and C. Reuter, "Data augmentation in natural language processing: a novel text generation approach for long and short text classifiers,"Int. J. Mach. Learn. Cybern., pp. 1-16, 2022, [Online]. Available: https://www.scopus.com/inward/record.uri?eid=2-s2.0-85146407671&partnerID=40&md5=dceb2e338cef7b2af8e32f4b5a7c72c0
. Venkateswararao and B. V. R. Reddy, "LT-SMF: long term stock market price trend prediction using optimal hybrid machine learning technique,"Artif. Intell. Rev., vol. 56, no. 6, pp. 5365-5402, 2023, doi: 10.1007/s10462-022-10291-5.
. Yuan, J. Yuan, T. Jiang, and Q. U. Ain, "Integrated Long-Term Stock Selection Models Based on Feature Selection and Machine Learning Algorithms for China Stock Market,"IEEE Access, vol. 8, pp. 22672-22685, 2020, doi: 10.1109/ACCESS.2020.2969293.
. D. Phan, "Housing price prediction using machine learning algorithms: The case of Melbourne city, Australia,"Proc. - Int. Conf. Mach. Learn. Data Eng. iCMLDE 2018, pp. 8-13, 2019, doi: 10.1109/iCMLDE.2018.00017.
.O. Fourar, M. Djebabra, W. Benhassine, and L. Boubaker, "Contribution of PCA/K-means methods to the mixed assessment of patient safety culture,"Int. J. Heal. Gov., vol. 26, no. 2, pp. 150-164, Jan. 2021, doi: 10.1108/IJHG-05-2020-0052.
.-P. Yang, "Cyber Democracy Versus Controlling Shareholders: The Implications of E-Voting System for Corporate Governance,"IJIIS Int. J. Informatics Inf. Syst., vol. 2, no. 3, pp. 136-142, 2019, doi: 10.47738/ijiis.v2i3.97.
. Zeng and S. Nantida, "Study on the Ideological and Political Practice Teaching of College Students Based on the Internet + Technology,"IJIIS Int. J. Informatics Inf. Syst., vol. 6, no. 1, pp. 24-30, 2023, doi: 10.47738/ijiis.v6i1.148.
.Fitriana, "Quality Analysis of Vaberaya.Banyumaskab.Go.Id Website on User Satisfaction on Vaccination Activities in Banyumas District Using Delone and Mclean Success Model,"IJIIS Int. J. Informatics Inf. Syst., vol. 5, no. 1, pp. 16-24, 2022, doi: 10.47738/ijiis.v5i1.121.
.S. Ejaz, M. R. Islam, M. Sifatullah, and A. Sarker, "Implementation of Principal Component Analysis on Masked and Non-masked Face Recognition,"1st Int. Conf. Adv. Sci. Eng. Robot. Technol. 2019, ICASERT 2019, no. Icasert, 2019, doi: 10.1109/ICASERT.2019.8934543.
.A. Prabowo, "Social Network Analysis for User Interaction Analysis on Social Media Regarding E-Commerce Business,"IJIIS Int. J. Informatics Inf. Syst., vol. 4, no. 2, pp. 95-102, 2021.
.Alqaryouti, N. Siyam, A. Abdel Monem, and K. Shaalan, "Aspect-based sentiment analysis using smart government review data,"Appl. Opt. Comput. Informatics, vol. ahead-of-p, no. ahead-of-print, Jan. 2020, doi: 10.1016/j.aci.2019.11.003.
.F. Tanyu, A. Abbaspour, Y. Alimohammadlou, and G. Tecuci, "Landslide susceptibility analyses using Random Forest, C4.5, and C5.0 with balanced and unbalanced datasets,"Catena, vol. 203, no. April, pp. 1-14, 2021, doi: 10.1016/j.catena.2021.105355.
. Pu, F. Chan, and A. Chong, "The Influence of Supply Chain Relationships on the Adoption of Open Standards Inter-Organizational Information Systems: A Conceptual Framework,"Int. J. Appl. Inf. Manag., vol. 1, no. 3 SE-Articles, pp. 91-98, Apr. 2021, doi: 10.47738/ijaim.v1i3.7.
.S. Alomari, "The Legal System for the Conversion of Commercial Companies in the Light of the Rules of the Saudi Corporate System,"Int. J. Appl. Inf. Manag., vol. 2, no. 4, pp. 106-111, Aug. 2022, doi: 10.47738/ijaim.v2i4.43.
. Diao, D. Niu, Z. Zang, and C. Chen, "Short-term weather forecast based on wavelet denoising and catboost,"Chinese Control Conf. CCC, vol. 2019-July, no. 2018, pp. 3760-3764, 2019, doi: 10.23919/ChiCC.2019.8865324.
. Hidayat, M. Matsuoka, S. Baja, and D. A. Rampisela, "Object-based image analysis for sago palm classification: The most important features from high-resolution satellite imagery,"Remote Sens., vol. 10, no. 8, 2018, doi: 10.3390/RS10081319.
.S. M. Nafis and S. Awang, "An enhanced hybrid feature selection technique using term frequency-inverse document frequency and support vector machine-recursive feature elimination for sentiment classification,"IEEE Access, vol. 9, pp. 52177-52192, 2021.
.Nordat, B. Tola, and M. Yasin, "The Effect of Work Motivation and Perception of College Support on Organizational Commitment and Organizational Citizenship Behavior in BKPSDM, Tangerang District,"Int. J. Appl. Inf. Manag., vol. 2, no. 3, pp. 37-46, 2022, doi: 10.47738/ijaim.v2i3.36.
.M. Faria, L. P. Reis, N. Lau, and G. Castillo, "Machine Learning algorithms applied to the classification of robotic soccer formations and opponentteams," 2010 IEEE Conf. Cybern. Intell. Syst. CIS 2010, pp. 344-349, 2010, doi: 10.1109/ICCIS.2010.5518540.
DOI: https://doi.org/10.47738/jads.v4i3.99
Refbacks
- There are currently no refbacks.
Journal of Applied Data Sciences
| ISSN | : | 2723-6471 (Online) |
| Publisher | : | Bright Publisher |
| Website | : | http://bright-journal.org/JADS |
| : | taqwa@amikompurwokerto.ac.id (principal contact) | |
| support@bright-journal.org (technical issues) |
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0