.png)
IndoBERT-SupCon: A Supervised Contrastive Learning Model for Analyzing Public Perception on Halal Tourism
Abstract
The primary objective of this research is to develop and evaluate a robust deep learning model for accurately analyzing stakeholder perceptions of halal tourism development in Pariaman, West Sumatra, based on qualitative textual data. The main contribution is the introduction of IndoBERT-SupCon, a novel architecture that enhances the Indonesian BERT model with a Supervised Contrastive Learning (SupCon) mechanism. A novel method for producing more discriminative feature representations for complex viewpoints is presented in this paper, which is one of the first to use this sophisticated fine-tuning technique to Indonesian socio-political sentiment analysis. Conceptually, the model is trained to simultaneously minimize classification error while optimizing the feature space, pulling representations of similar sentiments closer together and pushing dissimilar ones further apart. To achieve this, we collected 1,022 primary textual responses through online surveys with tourists and in-depth interviews with key stakeholders, including SME owners and government officials. The SMOTE oversampling technique was employed on the training data to mitigate class imbalance. Experimental results on the test data demonstrate that the IndoBERT-SupCon model achieved outstanding performance, with a final accuracy of 96.59% and a macro F1-score of 0.97. These results significantly surpass the performance of a standard fine-tuned IndoBERT baseline, confirming the effectiveness of the SupCon approach. The findings provide the Pariaman local government with a highly valid, data-driven tool for more responsive and effective policy formulation. This research offers a robust framework that can be applied to other public policy domains, showcasing the value of advanced deep learning in transforming qualitative stakeholder feedback into actionable insights.
Keywords
Full Text:
PDFReferences
F. & S. K. Bahardeen, “BRIDGING JOURNEYS Spotlight on RIDA Framework and Accessible Travel in GMTI 2024,” Glob. Muslim Travel Index, no. May, pp. 1–73, 2024, [Online]. Available: https://www.crescentrating.com/reports/global-muslim-travel-index-2024.html
L. Y. Arnakim, M. F. Karim, T. N. Mursitama, and M. P. Tahalele, “Tourism in ASEAN: A Catalyst for Regional Integration,” J. ASEAN Stud., vol. 11, no. 1, 2023, doi: 10.21512/jas.v11i1.10506.
A. Sutono, Sumaryadi, W. Rahtomo, F. F. Puksi, and O. Permana, “Re-modelling Muslim-friendly tourism value chain ecosystem: the case study of West Sumatera, Indonesia,” Cogent Soc. Sci., vol. 10, no. 1, p., 2024, doi: 10.1080/23311886.2024.2361536.
Sunarmo, M. Thurisaina, A. Amri, and A. Sagita, “Effects of Halal Awareness, Service Quality and Promotion on Visitor Decisions Through Destination Imagery as a Mediator,” Indones. J. Halal Res., vol. 6, no. 1, pp. 13–25, 2024, doi: 10.15575/ijhar.v6i1.19489.
S. Pongsakornrungsilp, P. Pongsakornrungsilp, T. Chouykaew, H. Niyomdecha, S. Chansamran, and Y. He, “Integrating Sustainability and Cultural Sensitivity: Clustering Muslim Tourist Lifestyles in the Andaman Coastal Cluster, Thailand,” Sustain., vol. 16, no. 21, pp. 1–15, 2024, doi: 10.3390/su16219542.
Supriono, Sudarmiatin, E. T. Djatmika, and A. Hermawan, “Muslim tourist perceived value as determinant on destination brand loyalty,” Tour. Hosp. Manag., vol. 30, no. 3, pp. 417–431, 2024, doi: 10.20867/thm.30.3.10.
D. Rusyaida, “Local wisdom as Halal tourism model in West Sumatera: an `Urf perspective,” Indones. J. Islam Muslim Soc., vol. 14, no. 2, pp. 259–287, 2024, doi: 10.18326/ijims.v14i2.259-287.
S. Abbasian, G. Onn, and D. Nordberg, “The perception of halal concept of hoteliers in the light of social exchange theory: a Swedish study,” J. Hosp. Tour. Insights, vol. 7, no. 4, pp. 2403–2421, 2024, doi: 10.1108/JHTI-01-2023-0038.
R. Pratiwi et al., “The Collaboration of Penta Helix to Develop Halal Tourism Villages in Batang, Cental Java,” Int. J. Sustain. Dev. Plan., vol. 19, no. 7, pp. 2753–2761, 2024, doi: 10.18280/ijsdp.190732.
M. K. Anam, P. P. Putra, R. A. Malik, T. A. Putra, and Y. Elva, “Enhancing the Performance of Machine Learning Algorithm for Intent Sentiment Analysis on Village Fund Topic,” vol. 6, no. 2, pp. 1102–1115, 2025.
N. R. P. Syallya, A. A. Pravitasari, and A. Helen, “NLP-Based Intent Classification Model for Academic Curriculum Chatbots in Universities Study Programs,” J. RESTI, vol. 9, no. 1, pp. 111–117, 2025, doi: 10.29207/resti.v9i1.6276.
A. S. Ekakristi, A. F. Wicaksono, and R. Mahendra, “Intermediate-task transfer learning for Indonesian NLP tasks,” Nat. Lang. Process. J., vol. 12, no. May, p. 100161, 2025, doi: 10.1016/j.nlp.2025.100161.
I. M. Permana and F. Adam, “Impact of Islamic attributes and destination image on tourist satisfaction and revisit intentions in halal tourism: A study in Banda Aceh,” Int. J. Adv. Appl. Sci., vol. 11, no. 4, pp. 118–127, 2024, doi: 10.21833/ijaas.2024.04.014.
A. Alam, R. T. Ratnasari, M. N. H. Ryandono, A. Prasetyo, Y. Syahidah, and F. A. Bafana, “A comparative systematic literature review between Indonesia and Malaysia Halal tourism studies (2010-2022),” Multidiscip. Rev., vol. 7, no. 3, 2024, doi: 10.31893/multirev.2024061.
A. Ariyanto, M. Adam, S. Musnadi, and M. A. Djalil, “Empowering and Influencing Factors of Intellectual and Spiritual Capital in Improving Organizational Performance at Tourism Institutions,” J. Ecohumanism, vol. 3, no. 7, pp. 5074–5085, 2024, doi: 10.62754/joe.v3i7.4616.
F. M. Suud, K. S. Rouzi, M. Al-Fairusy, T. Na’imah, H. Harinawati, and R. B. Yasa, “Tourism Education Development on the Coastline: Challenges Empirical Study on Islamic Law Province,” J. Ilm. Peuradeun, vol. 12, no. 3, pp. 1289–1310, 2024, doi: 10.26811/peuradeun.v12i3.1172.
L. Alfarajat, “Halal Food and Medical Tourism: Muslim Patients’ Experiences and Satisfaction in South Korea,” J. Relig. Health, vol. 63, no. 5, pp. 3274–3290, 2022, doi: 10.1007/s10943-022-01727-x.
W. Listiani, A. E. M. Ningdyah, and A. J. Rohaeni, “Desire to Revisit: Memorable Experiences Drive Domestic Tourists to Return to Bali,” J. Kaji. Bali, vol. 14, no. 1, pp. 147–168, 2024, doi: 10.24843/JKB.2024.v14.i01.p07.
K. Mnassri, R. Farahbakhsh, and N. Crespi, “Multilingual Hate Speech Detection: A Semi-Supervised Generative Adversarial Approach,” Entropy, vol. 26, no. 4, 2024, doi: 10.3390/e26040344.
G. Kątek, R. Kozik, A. Pawlicka, M. Pawlicki, and M. Choraś, “In depth analysis for securing the truth: Addressing the fake news challenge with graph neural networks,” Neurocomputing, vol. 654, no. June, p. 131327, 2025, doi: 10.1016/j.neucom.2025.131327.
G. Z. Nabiilah, S. Y. Prasetyo, Z. N. Izdihar, and A. S. Girsang, “BERT base model for toxic comment analysis on Indonesian social media,” Procedia Comput. Sci., vol. 216, no. 2022, pp. 714–721, 2022, doi: 10.1016/j.procs.2022.12.188.
M. Ahmad, M. Waqas, A. Hamza, S. Usman, I. Batyrshin, and G. Sidorov, “UA-HSD-2025: Multi-Lingual Hate Speech Detection from Tweets Using Pre-Trained Transformers,” Computers, vol. 14, no. 6, pp. 1–24, 2025, doi: 10.3390/computers14060239.
H. Honda and M. Hagiwara, “Context-dependent neuro-symbolic AI through self-supervised learning with large language models,” Neurocomputing, vol. 654, no. August, p. 131269, 2025, doi: 10.1016/j.neucom.2025.131269.
H. Xiao, F. Dornaika, J. Charafeddine, and J. Bi, “Metric learning-enhanced semi-supervised Graph Convolutional Network for multi-view learning,” Inf. Fusion, vol. 124, no. October 2024, p. 103420, 2025, doi: 10.1016/j.inffus.2025.103420.
F. Dornaika, Z. Ibrahim, J. Charafeddine, and A. Bosaghzadeh, “Towards dynamic self-training for scalable semi-supervised learning on graphs,” Neurocomputing, vol. 654, no. August, p. 131223, 2025, doi: 10.1016/j.neucom.2025.131223.
Z. He and H. Wang, “Fake News Detection Based on Contrastive Learning and Cross-Modal Interaction,” 2025.
S. Dehghan and M. F. Amasyali, “SupMPN: Supervised Multiple Positives and Negatives Contrastive Learning Model for Semantic Textual Similarity,” Appl. Sci., vol. 12, no. 19, 2022, doi: 10.3390/app12199659.
S. Kang, “LLM-Guided Weighted Contrastive Learning with Topic-Aware Masking for Efficient Domain Adaptation : A Case Study on Pulp-Era Science Fiction,” 2025.
E. Hashmi, S. Y. Yayilgan, M. M. Yamin, M. Abomhara, and M. Ullah, “Self-supervised hate speech detection in Norwegian texts with lexical and semantic augmentations,” Expert Syst. Appl., vol. 264, no. April 2024, p. 125843, 2025, doi: 10.1016/j.eswa.2024.125843.
M. M. Akhtar, N. S. Bhuiyan, R. Masood, M. Ikram, and S. S. Kanhere, “BotSSCL: Social Bot Detection with Self-Supervised Contrastive Learning,” Online Soc. Networks Media, vol. 48, no. April, p. 100318, 2025, doi: 10.1016/j.osnem.2025.100318.
X. Huang et al., “Optimizing sleep staging on multimodal time series: Leveraging borderline synthetic minority oversampling technique and supervised convolutional contrastive learning,” Comput. Biol. Med., vol. 166, no. August, p. 107501, 2023, doi: 10.1016/j.compbiomed.2023.107501.
L. Kong, W. Yang, and F. Wei, “Implicit Emotion Analysis Based on Improved Supervised Contrastive Learning,” Electron., vol. 12, no. 10, pp. 1–12, 2023, doi: 10.3390/electronics12102172.
Q. Wang, W. Zhang, T. Lei, and D. Peng, “Grouped Contrastive Learning of Self-Supervised Sentence Representation,” Appl. Sci., vol. 13, no. 17, 2023, doi: 10.3390/app13179873.
Y. Huang, J. Liu, and C. Lv, “Chains-BERT: A High-Performance Semi-Supervised and Contrastive Learning-Based Automatic Question-and-Answering Model for Agricultural Scenarios,” Appl. Sci., vol. 13, no. 5, 2023, doi: 10.3390/app13052924.
M. Ali, “Classification of imbalanced travel mode choice dataset with SMOTE and prediction using interpretable machine learning,” Sustain. Futur., vol. 10, no. August, p. 101119, 2025, doi: 10.1016/j.sftr.2025.101119.
A. Kummer, T. Ruppert, T. Medvegy, and J. Abonyi, “Machine learning-based software sensors for machine state monitoring - The role of SMOTE-based data augmentation,” Results Eng., vol. 16, no. November, 2022, doi: 10.1016/j.rineng.2022.100778.
D. Gonzalez-Cuautle et al., “Synthetic minority oversampling technique for optimizing classification tasks in botnet and intrusion-detection-system datasets,” Appl. Sci., vol. 10, no. 3, 2020, doi: 10.3390/app10030794.
M. Umer et al., “Scientific papers citation analysis using textual features and SMOTE resampling techniques,” Pattern Recognit. Lett., vol. 150, pp. 250–257, 2021, doi: 10.1016/j.patrec.2021.07.009.
M. Yusoff, Y. Mahmud, P. A. R. Azmi, and M. T. M. Sallehud-din, “The improvement of SMOTE-ENN-XGBoost through Yeo Johnson strategy on Dissolved Gas Analysis dataset,” Energy Reports, vol. 13, no. April, pp. 6281–6290, 2025, doi: 10.1016/j.egyr.2025.05.013.
J. Fonseca and F. Bacao, “Geometric SMOTE for imbalanced datasets with nominal and continuous features,” Expert Syst. Appl., vol. 234, no. July, p. 121053, 2023, doi: 10.1016/j.eswa.2023.121053.
I. Aruleba and Y. Sun, “Enhanced credit risk prediction using deep learning and SMOTE-ENN resampling,” Mach. Learn. with Appl., vol. 21, no. April, p. 100692, 2025, doi: 10.1016/j.mlwa.2025.100692.
R. Pramana, M. Jonathan, H. S. Yani, and R. Sutoyo, “A Comparison of BiLSTM, BERT, and Ensemble Method for Emotion Recognition on Indonesian Product Reviews,” Procedia Comput. Sci., vol. 245, no. C, pp. 399–408, 2024, doi: 10.1016/j.procs.2024.10.266.
M. T. Uliniansyah et al., “Twitter dataset on public sentiments towards biodiversity policy in Indonesia,” Data Br., vol. 52, p. 109890, 2024, doi: 10.1016/j.dib.2023.109890.
A. Jazuli, Widowati, and R. Kusumaningrum, “Optimizing Aspect-Based Sentiment Analysis Using BERT for Comprehensive Analysis of Indonesian Student Feedback,” Appl. Sci., vol. 15, no. 1, pp. 1–28, 2025, doi: 10.3390/app15010172.
S. K. Bharti et al., “Text-Based Emotion Recognition Using Deep Learning Approach,” Comput. Intell. Neurosci., vol. 2022, 2022, doi: 10.1155/2022/2645381.
M. K. Anam et al., “Improved Performance of Hybrid GRU-BiLSTM for Detection Emotion on Twitter Dataset,” J. Appl. Data Sci., vol. 6, no. 1, pp. 354–365, 2025, doi: 10.47738/jads.v6i1.459.
P. P. Putra, M. K. Anam, A. S. Chan, A. Hadi, and N. Hendri, “Optimizing Sentiment Analysis on Imbalanced Hotel Review Data Using SMOTE and Ensemble Machine Learning Techniques,” vol. 6, no. 2, pp. 936–951, 2025.
C. Owen and D. Suhartono, “Intent Classification in Artificial Intelligence-Based Customer Service Chatbot for E-Wallet Service Providers,” Int. J. Comput. Digit. Syst., vol. 17, no. 1, pp. 1–9, 2025, doi: 10.12785/ijcds/1571046212.
DOI: https://doi.org/10.47738/jads.v7i1.1045
Refbacks
- There are currently no refbacks.
Journal of Applied Data Sciences
| ISSN | : | 2723-6471 (Online) |
| Publisher | : | Bright Publisher |
| Website | : | http://bright-journal.org/JADS |
| : | taqwa@amikompurwokerto.ac.id (principal contact) | |
| support@bright-journal.org (technical issues) |
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0