A Hybrid LSTM–Stacking–SMOTE Model for Weather-Aware Palm Oil Price Prediction Addressing Data Imbalance and Forecast Accuracy

Kusmanto Kusmanto, S Subagio, Erni Manja

Abstract


Accurate forecasting of palm oil prices is crucial for agribusiness decision-making due to high market volatility influenced by dynamic weather conditions. This study proposes a novel hybrid deep learning model combining Long Short-Term Memory (LSTM), Stacking Ensemble, and Synthetic Minority Over-sampling Technique (SMOTE) to improve predictive accuracy and handle class imbalance in price trend classification. The model was trained using a multivariate time-series dataset sourced from Kaggle, consisting of daily records of temperature, humidity, rainfall, and palm oil prices. A binary classification scheme was applied by labeling instances as either price increase (class 1) or price stable/decrease (class 0), based on a 0% price change threshold. Four experimental configurations were evaluated: standard LSTM, LSTM + SMOTE, LSTM + Stacking, and the proposed LSTM + SMOTE + Stacking. The proposed model outperformed all baselines, achieving the highest accuracy of 83.12%, an F1-score of 0.8466, MAE of 0.1688, RMSE of 0.4109, and a perfect recall of 1.0000, indicating excellent sensitivity to minority class trends. In contrast, the standard LSTM achieved only 77.32% accuracy and an F1-score of 0.7224, showing limited ability in handling imbalanced data. Visualization of loss curves and confusion matrices confirmed the model’s learning stability and classification effectiveness. This study contributes a novel integration of ensemble learning and oversampling in time-series commodity forecasting and demonstrates the effectiveness of this approach in capturing weather-driven price patterns, offering a robust framework for predictive analytics in agriculture.


Keywords


Palm Oil Price Prediction; LSTM; Stacking Ensemble; SMOTE; Deep Learning; Weather Data

Full Text:

PDF

References


Y. Asbur, “Improvement Of Soil Chemical Properties In Mature Oil Palm Plantations By Pruning And Immersing Of Weeds As Cover Crops,” Universal Journal Of Agricultural Research, Vol. 12, No. 1, Pp. 188–194, 2024, Doi: 10.13189/Ujar.2024.120118.

C. I. N. Indonesia, “Palm’journal,” Palmoilina.Asia.

M. S. Bahar And A. A. Karia, “A Dual Methods Approach To Crude Palm Oil Price Forecasting In Malaysia : Insights From Ardl And Lstm,” No. 2008, Pp. 106–124.

M. Rashid, B. S. Bari, Y. Yusup, M. A. Kamaruddin, And N. Khan, “A Comprehensive Review Of Crop Yield Prediction Using Machine Learning Approaches With Special Emphasis On Palm Oil Yield Prediction,” Ieee Access, Vol. 9, Pp. 63406–63439, 2021, Doi: 10.1109/Access.2021.3075159.

F. Danitasari, M. Ryan, D. Handoko, And I. Pramuwardani, “Improving Accuracy Of Daily Weather Forecast Model At Soekarno-Hatta Airport Using Bilstm With Smote And Adasyn,” Jurnal Penelitian Pendidikan Ipa, Vol. 10, No. 1, Pp. 179–193, 2024, Doi: 10.29303/Jppipa.V10i1.5906.

T. Benil, “Efficient Data Pruning Using Optimal Knn For Weather Forecasting In Cloud Computing,” International Journal Of Global Warming, Vol. 30, No. 2, Pp. 137–151, 2023, Doi: 10.1504/Ijgw.2023.130984.

I. Intan, S. Aminah, D. Ghani, And A. T. C. Koswara, “Analisis Performansi Prakiraan Cuaca Menggunakan Algoritma Machine Learning Performance Analysis Of Weather Forecasting Using Machine Learning Algorithms,” Pp. 1–8, 2021, Doi: 10.30818/Jpkm.2021.2060221.

C. Mcknight, “Prices For A Second-Generation Biofuel Industry In Canada: Market Linkages Between Canadian Wheat And Us Energy And Agricultural Commodities,” Canadian Journal Of Agricultural Economics, Vol. 69, No. 3, Pp. 337–351, 2021, Doi: 10.1111/Cjag.12295.

M. R.L, “Market Efficiency And Price Risk Management Of Agricultural Commodity Prices In India,” Journal Of Modelling In Management, Vol. 18, No. 1, Pp. 190–211, 2023, Doi: 10.1108/Jm2-04-2021-0104.

M. Garg, “Price Discovery Mechanism And Volatility Spillover Between National Agriculture Market And National Commodity And Derivatives Exchange: The Study Of The Indian Agricultural Commodity Market,” Journal Of Risk And Financial Management, Vol. 16, No. 2, 2023, Doi: 10.3390/Jrfm16020062.

A. P. Windarto, T. Herawan, And P. Alkhairi, “Prediction Of Kidney Disease Progression Using K-Means Algorithm Approach On Histopathology Data,” In Artificial Intelligence, Data Science And Applications, Cham: Springer Nature Switzerland, 2024, Pp. 492–497. Doi: 10.1007/978-3-031-48465-0_66.

S. Defit, A. P. Windarto, And P. Alkhairi, “Comparative Analysis Of Classification Methods In Sentiment Analysis: The Impact Of Feature Selection And Ensemble Techniques Optimization,” Telematika, Vol. 17, No. 1, Pp. 52–67, 2024.

J. D. Rosita P And W. S. Jacob, “Multi-Objective Genetic Algorithm And Cnn-Based Deep Learning Architectural Scheme For Effective Spam Detection,” International Journal Of Intelligent Networks, Vol. 3, No. December 2021, Pp. 9–15, 2022, Doi: 10.1016/J.Ijin.2022.01.001.

N. N. Prakash, V. Rajesh, D. L. Namakhwa, S. Dwarkanath Pande, And S. H. Ahammad, “A Densenet Cnn-Based Liver Lesion Prediction And Classification For Future Medical Diagnosis,” Scientific African, Vol. 20, P. E01629, 2023, Doi: 10.1016/J.Sciaf.2023.E01629.

J. Yu, “Recurrence Plot Image And Googlenet Based Historical Abuse Backtrace For Li-Ion Batteries,” Journal Of Energy Storage, Vol. 74, 2023, Doi: 10.1016/J.Est.2023.109378.

G. Feng, “Research On Emotion Recognition In Electroencephalogram Based On Independent Component Analysis-Recurrence Plot And Improved Efficientnet,” Sheng Wu Yi Xue Gong Cheng Xue Za Zhi = Journal Of Biomedical Engineering = Shengwu Yixue Gongchengxue Zazhi, Vol. 41, No. 6, Pp. 1103–1109, 2024, Doi: 10.7507/1001-5515.202406029.

X. Zhao, “Remote Sensing Image Change Detection Based On Improved Deeplabv3+ Siamese Network,” Journal Of Geo-Information Science, Vol. 24, No. 8, Pp. 1604–1616, 2022, Doi: 10.12082/Dqxxkx.2022.220029.

H. A. Shah, F. Saeed, S. Yun, J. H. Park, A. Paul, And J. M. Kang, “A Robust Approach For Brain Tumor Detection In Magnetic Resonance Images Using Finetuned Efficientnet,” Ieee Access, Vol. 10, Pp. 65426–65438, 2022, Doi: 10.1109/Access.2022.3184113.

M. S. Puchaicela-Lozano, “Deep Learning For Glaucoma Detection: R-Cnn Resnet-50 And Image Segmentation,” Journal Of Advances In Information Technology, Vol. 14, No. 6, Pp. 1186–1197, 2023, Doi: 10.12720/Jait.14.6.1186-1197.

S. Jameer, “A Dcnn-Lstm Based Human Activity Recognition By Mobile And Wearable Sensor Networks,” Alexandria Engineering Journal, Vol. 80, Pp. 542–552, 2023, Doi: 10.1016/J.Aej.2023.09.013.

J. A. Adisa, “The Effect Of Imbalanced Data And Parameter Selection Via Genetic Algorithm Long Short-Term Memory (Lstm) For Financial Distress Prediction,” Iaeng International Journal Of Applied Mathematics, Vol. 53, No. 3, 2023.

S. K. Challa, “An Optimized-Lstm And Rgb-D Sensor-Based Human Gait Trajectory Generator For Bipedal Robot Walking,” Ieee Sensors Journal, Vol. 22, No. 24, Pp. 24352–24363, 2022, Doi: 10.1109/Jsen.2022.3222412.

M. A. Khatun, “Deep Cnn-Lstm With Self-Attention Model For Human Activity Recognition Using Wearable Sensor,” Ieee Journal Of Translational Engineering In Health And Medicine, Vol. 10, 2022, Doi: 10.1109/Jtehm.2022.3177710.

A. Sarkar, “An Effective And Novel Approach For Brain Tumor Classification Using Alexnet Cnn Feature Extractor And Multiple Eminent Machine Learning Classifiers In Mris,” Journal Of Sensors, Vol. 2023, 2023, Doi: 10.1155/2023/1224619.

G. Kaur And A. Sharma, “A Deep Learning-Based Model Using Hybrid Feature Extraction Approach For Consumer Sentiment Analysis,” Journal Of Big Data, Vol. 10, No. 1, 2023, Doi: 10.1186/S40537-022-00680-6.

V. Sunanthini, “Comparison Of Cnn Algorithms For Feature Extraction On Fundus Images To Detect Glaucoma,” Journal Of Healthcare Engineering, Vol. 2022, 2022, Doi: 10.1155/2022/7873300.

A. Gogineni, “Evaluating Machine Learning Algorithms For Predicting Compressive Strength Of Concrete With Mineral Admixture Using Long Short-Term Memory (Lstm) Technique,” Asian Journal Of Civil Engineering, Vol. 25, No. 2, Pp. 1921–1933, 2024, Doi: 10.1007/S42107-023-00885-X.

A. Beaulieu, “Ultra-Wideband Data As Input Of A Combined Efficientnet And Lstm Architecture For Human Activity Recognition,” Journal Of Ambient Intelligence And Smart Environments, Vol. 14, No. 3, Pp. 157–172, 2022, Doi: 10.3233/Ais-210462.

K. Balaraman, “Hybrid Resnet And Bidirectional Lstm Based Deep Learning Model For Cardiovascular Disease Detection Using Ppg Signals,” Journal Of Machine And Computing, Vol. 3, No. 3, Pp. 351–359, 2023, Doi: 10.53759/7669/Jmc202303030.

I. Janbain, “Use Of Long Short-Term Memory Network (Lstm) In The Reconstruction Of Missing Water Level Data In The River Seine,” Hydrological Sciences Journal, Vol. 68, No. 10, Pp. 1372–1390, 2023, Doi: 10.1080/02626667.2023.2221791.

A. Rehman, T. Alam, M. Mujahid, F. S. Alamri, B. Al Ghofaily, And T. Saba, “Rdet Stacking Classifier: A Novel Machine Learning Based Approach For Stroke Prediction Using Imbalance Data,” Peerj Computer Science, Vol. 9, Pp. 1–28, 2023, Doi: 10.7717/Peerj-Cs.1684.

V. Mohanavel, “Influence Of Stacking Sequence And Fiber Content On The Mechanical Properties Of Natural And Synthetic Fibers Reinforced Penta-Layered Hybrid Composites,” Journal Of Natural Fibers, Vol. 19, No. 13, Pp. 5258–5270, 2022, Doi: 10.1080/15440478.2021.1875368.

S. S. Rani, “An Automated Lion-Butterfly Optimization (Lbo) Based Stacking Ensemble Learning Classification (Selc) Model For Lung Cancer Detection,” Iraqi Journal For Computer Science And Mathematics, Vol. 4, No. 3, Pp. 87–100, 2023, Doi: 10.52866/Ijcsm.2023.02.03.008.

Y. S. Taspinar, “Classification By A Stacking Model Using Cnn Features For Covid-19 Infection Diagnosis,” Journal Of X Ray Science And Technology, Vol. 30, No. 1, Pp. 73–88, 2022, Doi: 10.3233/Xst-211031.

N. Mqadi, “A Smote Based Oversampling Data-Point Approach To Solving The Credit Card Data Imbalance Problem In Financial Fraud Detection,” International Journal Of Computing And Digital Systems, Vol. 10, No. 1, Pp. 277–286, 2021, Doi: 10.12785/Ijcds/100128.

A. Kishor, “Early And Accurate Prediction Of Diabetics Based On Fcbf Feature Selection And Smote,” International Journal Of System Assurance Engineering And Management, Vol. 15, No. 10, Pp. 4649–4657, 2024, Doi: 10.1007/S13198-021-01174-Z.

L. Azoulay-Younes, “Zinc Electrode Manufacturing Quality Control With Machine Learning: Using Smote & Image Augmentation To Prevent Overfitting,” Journal Of Engineering Research Kuwait, 2025, Doi: 10.1016/J.Jer.2025.01.002.

P. C. Y. Cheah, “Enhancing Financial Fraud Detection Through Addressing Class Imbalance Using Hybrid Smote-Gan Techniques,” International Journal Of Financial Studies, Vol. 11, No. 3, 2023, Doi: 10.3390/Ijfs11030110.

N. A. A. Khleel, “A Novel Approach For Software Defect Prediction Using Cnn And Gru Based On Smote Tomek Method,” Journal Of Intelligent Information Systems, Vol. 60, No. 3, Pp. 673–707, 2023, Doi: 10.1007/S10844-023-00793-1.

S. R. Dani, S. Solikhun, And D. Priyanto, “The Performance Machine Learning Powel-Beale For Predicting Rubber Plant Production In Sumatera,” International Journal Of Engineering And Computer Science Applications (Ijecsa), Vol. 2, No. 1, Pp. 29–38, 2023, Doi: 10.30812/Ijecsa.V2i1.2420.

I. Ranggadara, U. M. Buana, A. Ratnasari, And U. M. Buana, “Backpropagation Neural Network For Predict Sugarcane Stock Availability,” International Journal Of Advanced Trends In Computer Science And Engineering, Vol. 9, No. 5, Pp. 8279–8284, 2020, Doi: 10.30534/Ijatcse/2020/197952020.

L. Tong, “A Novel Deep Learning Bi-Gru-I Model For Real-Time Human Activity Recognition Using Inertial Sensors,” Ieee Sensors Journal, Vol. 22, No. 6, Pp. 6164–6174, 2022, Doi: 10.1109/Jsen.2022.3148431.

D. Malhotra, “Hybrid Deep Learning Model For Covid-19 Prediction Using Convolutional Neural Network (Cnn) And Bidirectional Long Short-Term Memory (Lstm) Network,” International Journal Of Computer Theory And Engineering, Vol. 15, No. 3, Pp. 125–129, 2023, Doi: 10.7763/Ijcte.2023.V15.1341.

S. Y. Xiong, “A Hybrid Cnn–Rnn Model For Rainfall–Runoff Modeling In The Potteruvagu Watershed Of India,” Clean – Soil, Air, Water, Vol. 10, No. 3, P. 2300341, 2024, Doi: Https://Doi.Org/10.1002/Clen.202300341.

P. R. Shekar, A. Mathew, And K. V. Sharma, “A Hybrid Cnn–Rnn Model For Rainfall–Runoff Modeling In The Potteruvagu Watershed Of India,” Clean – Soil, Air, Water, Vol. N/A, No. N/A, P. 2300341, 2024, Doi: Https://Doi.Org/10.1002/Clen.202300341.

Enung, “Hourly Discharge Prediction Using Long Short-Term Memory Recurrent Neural Network (Lstm-Rnn) In The Upper Citarum River,” International Journal Of Geomate, Vol. 23, No. 98, Pp. 147–154, 2022, Doi: 10.21660/2022.98.3462.

A. Bâra And S. V. Oprea, “Machine Learning Algorithms For Power System Sign Classification And A Multivariate Stacked Lstm Model For Predicting The Electricity Imbalance Volume,” International Journal Of Computational Intelligence Systems, Vol. 17, No. 1, 2024, Doi: 10.1007/S44196-024-00464-1.

S. Nizarudeen, “Multi-Layer Resnet-Densenet Architecture In Consort With The Xgboost Classifier For Intracranial Hemorrhage (Ich) Subtype Detection And Classification,” Journal Of Intelligent And Fuzzy Systems, Vol. 44, No. 2, Pp. 2351–2366, 2023, Doi: 10.3233/Jifs-221177.

R. E. Ako, “Pilot Study On Fibromyalgia Disorder Detection Via Xgboosted Stacked-Learning With Smote-Tomek Data Balancing Approach,” Nipes Journal Of Science And Technology Research, Vol. 7, No. 1, Pp. 12–22, 2025, Doi: 10.37933/Nipes/7.1.2025.2.

V. D. Gowda, “A Novel Rf-Smote Model To Enhance The Definite Apprehensions For Iot Security Attacks,” Journal Of Discrete Mathematical Sciences And Cryptography, Vol. 26, No. 3, Pp. 861–873, 2023, Doi: 10.47974/Jdmsc-1766.

M. Waqar, H. Dawood, H. Dawood, N. Majeed, A. Banjar, And R. Alharbey, “An Efficient Smote-Based Deep Learning Model For Heart Attack Prediction,” Scientific Programming, Vol. 2021, 2021, Doi: 10.1155/2021/6621622.

A. Arafa, “Rn-Smote: Reduced Noise Smote Based On Dbscan For Enhancing Imbalanced Data Classification,” Journal Of King Saud University Computer And Information Sciences, Vol. 34, No. 8, Pp. 5059–5074, 2022, Doi: 10.1016/J.Jksuci.2022.06.005.

J. Nanda, “Sshm: Smote-Stacked Hybrid Model For Improving Severity Classification Of Code Smell,” International Journal Of Information Technology Singapore, Vol. 14, No. 5, Pp. 2701–2707, 2022, Doi: 10.1007/S41870-022-00943-8.




DOI: https://doi.org/10.47738/jads.v6i4.922

Refbacks

  • There are currently no refbacks.



Barcode

Journal of Applied Data Sciences

ISSN:2723-6471 (Online)
Publisher:Bright Publisher
Website:http://bright-journal.org/JADS
Email:taqwa@amikompurwokerto.ac.id (principal contact)
  support@bright-journal.org (technical issues)

This work is licensed under a Creative Commons Attribution-ShareAlike 4.0