Sentiment and Emotion Classification Model Using Hybrid Textual and Numerical Features: A Case Study of Mental Health Counseling

Indri Ramayanti, Latius Hermawan, Rizma Adlia Syakurah, Deris Stiawan, Meilinda Meilinda, Edi Surya Negara, Muhammad Fahmi, Ahmad Ghiffari, Muhammad Qurhanul Rizqie

Abstract


Mental health issues among individuals, particularly in counseling contexts, require practical tools to understand and address emotional states. This study explores the application of machine learning models for emotion detection in mental health counseling conversations, focusing on four algorithms: Bernoulli Naive Bayes, Decision Tree, Logistic Regression, and Random Forest. The dataset, derived from transcribed counseling sessions, underwent preprocessing, including stemming, stopword removal, and TF-IDF vectorization to create structured inputs for classification. Emotional categories such as "Depresi" (Depression), "Kecewa" (Dissapointed), "Senang" (Happy), "Bingung" (Confused) and "Stres" (Stress) were analyzed to evaluate model performance. Results indicated that Logistic Regression achieved the highest accuracy at 82%, showcasing its reliability and scalability, followed closely by Random Forest with 81%, demonstrating robustness in handling complex data structures. Bernoulli Naive Bayes performed competitively at 80%, excelling in computational efficiency, while Decision Tree recorded the lowest accuracy at 70%, reflecting its limitations in managing overlapping features and high-dimensional data. These findings highlight the potential of machine learning in addressing the increasing demand for scalable mental health support tools. The study underscores the importance of model selection, balanced datasets, and feature engineering to improve classification accuracy. Future work includes developing AI-driven chatbots for real-time emotion detection and integrating multimodal data to enhance interpretability. This research contributes to advancing automated solutions for mental health care, offering new pathways for timely and personalized interventions.


Keywords


Sentiment Analysis, Emotion, Classification, Mental Health, Counseling

Full Text:

PDF

References


M. Srivastava, I. Singh, Er. S. Khanna, and Dr. A. K. Srivastava, “Depression Detection And Sentiments Analysis,” International Journal Of Scientific Research In Engineering And Management, vol. 07, no. 04. Indospace Publications, Apr. 09, 2023. doi: 10.55041/ijsrem18726.

Mr. J. Dias and Dr. P. D. Tawde, “Predicting Mental Health Disorders based on Sentiment Analysis,” International Journal Of Scientific Research In Engineering And Management, vol. 08, no. 09. Indospace Publications, pp. 1–4, Sep. 18, 2024. doi: 10.55041/ijsrem37524.

M. Deshpande and V. Rao, “Depression detection using emotion artificial intelligence,” 2017 International Conference on Intelligent Sustainable Systems (ICISS). IEEE, Dec. 2017. doi: 10.1109/iss1.2017.8389299.

A. B. Kathole, S. Lonare, G. Dharmale, J. Katti, K. Vhatkar, and V. V. Kimbahune, “Sentiment Analysis-Based Automatic Stress and Emotion Recognition using Weighted Fused Fusion-Based Cascaded DTCN with Attention Mechanism from EEG Signal,” Journal of Information & Knowledge Management, vol. 23, no. 05. World Scientific Pub Co Pte Ltd, Jun. 07, 2024. doi: 10.1142/s0219649224500618.

J. Alanya-Beltran, A. Gehlot, U. Gurav, C. Valderrama-Zapata, H. Anandaram, and A. Jain, “Emotional Detection Based on Bio Information and Data Analytics,” 2022 International Conference on Innovative Computing, Intelligent Communication and Smart Electrical Systems (ICSES). IEEE, pp. 1–6, Jul. 15, 2022. doi: 10.1109/icses55317.2022.9914197.

D. K. Choudhary, A. Gupta, S. Singh, T. Abhinav, and T. Agrawal, “Sentiment Analysis for Depression Detection Using Artificial Intelligence,” 2024 3rd International Conference on Artificial Intelligence For Internet of Things (AIIoT). IEEE, pp. 1–5, May 03, 2024. doi: 10.1109/aiiot58432.2024.10574749.

R. Cobo‐Rendón, M. V. Pérez‐Villalobos, D. Páez‐Rovira, and M. Gracia‐Leiva, “A longitudinal study: Affective wellbeing, psychological wellbeing, self‐efficacy, and academic performance among first‐year undergraduate students,” Scandinavian Journal of Psychology, vol. 61, no. 4. Wiley, pp. 518–526, Feb. 05, 2020. doi: 10.1111/sjop.12618.

S. S. Sethi and K. Jain, “AI technologies for social-emotional learning: recent research and future directions,” Journal of Research in Innovative Teaching & Learning, vol. 17, no. 2. Emerald, pp. 213–225, May 27, 2024. doi: 10.1108/jrit-03-2024-0073.

A. de León Languré and M. Zareei, “Evaluating the Effect of Emotion Models on the Generalizability of Text Emotion Detection Systems,” IEEE Access, vol. 12. Institute of Electrical and Electronics Engineers (IEEE), pp. 70489–70500, 2024. doi: 10.1109/access.2024.3401203.

A. Waheed Awan, I. Taj, S. Khalid, S. Muhammad Usman, A. S. Imran, and M. Usman Akram, “Advancing Emotional Health Assessments: A Hybrid Deep Learning Approach Using Physiological Signals for Robust Emotion Recognition,” IEEE Access, vol. 12. Institute of Electrical and Electronics Engineers (IEEE), pp. 141890–141904, 2024. doi: 10.1109/access.2024.3463746.

E. M. Arias, J. Parraga-Alava, and D. Z. Montenegro, “Stress Detection among Higher Education Students: A Comprehensive Systematic Review of Machine Learning Approaches,” 2024 Tenth International Conference on eDemocracy & amp; eGovernment (ICEDEG). IEEE, pp. 1–8, Jun. 24, 2024. doi: 10.1109/icedeg61611.2024.10702055.

I. Malakar and B. Nepal, “Conceptualizing Explorative Data Analysis in Applied Statistics,” Patan Gyansagar, vol. 6, no. 1. Nepal Journals Online (JOL), pp. 46–63, Jul. 09, 2024. doi: 10.3126/pg.v6i1.67406.

C. D. Manning, H. Schütze, and P. Raghavan, Introduction to Information Retrieval. Cambridge, UK: Cambridge University Press, 2008.T

X. Li, Y. Wang, and R. Ruiz, “A Survey on Sparse Learning Models for Feature Selection,” IEEE Transactions on Cybernetics, vol. 52, no. 3. Institute of Electrical and Electronics Engineers (IEEE), pp. 1642–1660, Mar. 2022. doi: 10.1109/tcyb.2020.2982445.

L. Sha, M. Rakovic, A. Das, D. Gasevic, and G. Chen, “Leveraging Class Balancing Techniques to Alleviate Algorithmic Bias for Predictive Tasks in Education,” IEEE Transactions on Learning Technologies, vol. 15, no. 4. Institute of Electrical and Electronics Engineers (IEEE), pp. 481–492, Aug. 01, 2022. doi: 10.1109/tlt.2022.3196278

C. M. Bishop, Pattern Recognition and Machine Learning. New York, NY, USA: Springer, 2006.

S. Gan, S. Shao, L. Chen, L. Yu, and L. Jiang, “Adapting Hidden Naive Bayes for Text Classification,” Mathematics, vol. 9, no. 19. MDPI AG, p. 2378, Sep. 25, 2021. doi: 10.3390/math9192378.

I. D. Mienye and N. Jere, “A Survey of Decision Trees: Concepts, Algorithms, and Applications,” IEEE Access, vol. 12. Institute of Electrical and Electronics Engineers (IEEE), pp. 86716–86727, 2024. doi: 10.1109/access.2024.3416838.

D. W. Hosmer Jr., S. Lemeshow, and R. X. Sturdivant, “Applied Logistic Regression,” Wiley Series in Probability and Statistics. Wiley, Mar. 22, 2013. doi: 10.1002/9781118548387.

L. Breiman, Machine Learning, vol. 45, no. 1. Springer Science and Business Media LLC, pp. 5–32, 2001. doi: 10.1023/a:1010933404324.




DOI: https://doi.org/10.47738/jads.v6i3.632

Refbacks

  • There are currently no refbacks.



Barcode

Journal of Applied Data Sciences

ISSN:2723-6471 (Online)
Publisher:Bright Publisher
Website:http://bright-journal.org/JADS
Email:taqwa@amikompurwokerto.ac.id (principal contact)
  support@bright-journal.org (technical issues)

This work is licensed under a Creative Commons Attribution-ShareAlike 4.0