Aspect-Based Sentiment Analysis of Healthcare Reviews from Indonesian Hospitals based on Weighted Average Ensemble

Esther Irawati Setiawan, Patrick Tjendika, Joan Santoso, FX Ferdinandus, Gunawan Gunawan, Kimiya Fujisawa

Abstract


Public assessments are essential for evaluating hospital quality and meeting patient demand for superior medical treatment. This study offers a novel approach to aspect-based sentiment analysis (ABSA), which consists of aspect extraction, emotion categorization, and aspect classification. The goal is to examine patient reviews (6,711 reviews) from Google assessments of 20 Indonesian hospitals, broken down by categories including cost, doctor, nurse, and other categories. For example, there are 469 good, 66 negative, and 7 neutral ratings for cleanliness and 93 positive, 125 negative, and 19 neutral reviews for pricing in the sample, which covers a range of attitudes. Using the Conditional Random Field (CRF) approach, aspect phrase extraction was refined and word characteristics and positional tags were adjusted, resulting in an improvement in the F1-score from 0.9447 to 0.9578. The Support Vector Machine (SVM) model had the greatest F1-score of 0.8424 out of two strategies used for aspect categorization. With the addition of sentiment words, sentiment classification improved and led by SVM to an ideal F1-score of 0.7913. For aspect and sentiment classification, a Weighted Average Ensemble approach incorporating SVM, Naïve Bayes, and K-Nearest Neighbors was employed, yielding F1-scores of 0.7881 and 0.8413, respectively. The use of an ensemble technique for sentiment and aspect classification and the incorporation of hyperparameter optimization in CRF for aspect term extraction, which led to notable performance gains, are the innovative aspects of this work.

Keywords


Aspect-Based Sentiment Analysis; Aspect Term Extraction; Aspect Classification; Sentiment Classification; Conditional Random Field; Weighted Average Ensemble; Support Vector Machine; Naïve Bayes; K-Nearest Neighbors

Full Text:

PDF

References


S. Han, Y. Liu, and J. Yan, “Neural network ensemble method study for wind power prediction,” in 2011 asia-pacific power and energy engineering conference, 2011, pp. 1–4.

M. Afzaal, M. Usman, and A. Fong, “Tourism mobile app with aspect-based sentiment classification framework for tourist reviews,” IEEE Transactions on Consumer Electronics, vol. 65, no. 2, pp. 233–242, 2019.

B. Ray, A. Garain, and R. Sarkar, “An ensemble-based hotel recommender system using sentiment analysis and aspect categorization of hotel reviews,” Appl Soft Comput, vol. 98, p. 106935, 2021.

B. Kane et al., “CNN-LSTM-CRF for Aspect-Based Sentiment Analysis: A Joint Method Applied to French Reviews.,” in ICAART (1), 2021, pp. 498–505.

V. Hetal and others, “Ensemble models for aspect category related absa subtasks,” Turkish Journal of Computer and Mathematics Education (TURCOMAT), vol. 12, no. 13, pp. 2348–2364, 2021.

C. Sutton, A. McCallum, and others, “An introduction to conditional random fields,” Foundations and Trends® in Machine Learning, vol. 4, no. 4, pp. 267–373, 2012.

S. Zheng et al., “Conditional random fields as recurrent neural networks,” in Proceedings of the IEEE international conference on computer vision, 2015, pp. 1529–1537.

T. T. Truyen and P. Dinh, “A Practitioner Guide to Conditional Random Fields for Sequential Labelling,” Curtion University of Technology, 2008.

M. S. H. Talukder and A. K. Sarkar, “Nutrients deficiency diagnosis of rice crop by weighted average ensemble learning,” Smart Agricultural Technology, vol. 4, p. 100155, 2023.

V. I. Santoso, G. Virginia, and Y. Lukito, “Penerapan Sentiment Analysis Pada Hasil Evaluasi Dosen Dengan Metode Support Vector Machine,” Jurnal Transformatika, vol. 14, no. 2, pp. 72–76, 2017.

E. M. K. Reddy, A. Gurrala, V. B. Hasitha, and K. V. R. Kumar, “Introduction to Naive Bayes and a review on its subtypes with applications,” Bayesian reasoning and gaussian processes for machine learning applications, pp. 1–14, 2022.

M. Nanja and P. Purwanto, “Metode k-nearest neighbor berbasis forward selection untuk prediksi harga komoditi lada,” Pseudocode, vol. 2, no. 1, pp. 53–64, 2015.

D. Ekawati and M. L. Khodra, “Aspect-based sentiment analysis for Indonesian restaurant reviews,” in 2017 International Conference on Advanced Informatics, Concepts, Theory, and Applications (ICAICTA), 2017, pp. 1–6.




DOI: https://doi.org/10.47738/jads.v5i4.328

Refbacks

  • There are currently no refbacks.



Barcode

Journal of Applied Data Sciences

ISSN:2723-6471 (Online)
Publisher:Bright Publisher
Website:http://bright-journal.org/JADS
Email:taqwa@amikompurwokerto.ac.id (principal contact)
  support@bright-journal.org (technical issues)

This work is licensed under a Creative Commons Attribution-ShareAlike 4.0