.png)
Long short-term memory-based chatbot for vocational registration information services
Abstract
The development of chatbots can communicate fluently like humans thanks to the Natural Language Processing (NLP) technology. Using this technology, chatbots can provide more accurate and natural responses, providing an almost the same experience as human interaction. Therefore, chatbot technology is in great demand by companies and government agencies as a cost-effective solution for information and administrative services that require little human effort and can operate 24/7. The registration information service at BLK Surabaya still uses an operator who serves prospective trainees and answers questions via social media or chat. However, these operators have limitations in terms of time and effort. The purpose of this study is to examine how to use chatbots to answer questions about registration information training at BLK Surabaya using the Long Short Term Memory (LSTM) algorithm with a dataset of questions collected in the form of Frequently Asked Questions (FAQ) in Indonesian. The dataset consists of 2,636 labeled samples of questions, which were divided into three sets: 60% for training (1,581 pieces), 20% for validation (527 samples), and 20% for testing (528 samples) to evaluate the model's performance. Several steps were taken in implementing this research, including changing the list of questions and answers into the JSON data format, preprocessing, creating LSTM modeling, data training, and data testing. The test results show that Chatbot can provide accurate solutions related to training registration questions with Precision of 88.4%, Accuracy of 87.6%, and Recall of 87.3%.
Keywords
Full Text:
PDFReferences
A. Xu, Z. Liu, Y. Guo, V. Sinha, and R. Akkiraju, “A new chatbot for customer service on social media,” in Proceedings of the 2017 CHI conference on human factors in computing systems, 2017, pp. 3506–3510.
E. A. J. Croes and M. L. Antheunis, “Can we be friends with Mitsuku? A longitudinal study on the process of relationship formation between humans and a social chatbot,” J Soc Pers Relat, vol. 38, no. 1, pp. 279–300, 2021.
E. Adamopoulou and L. Moussiades, “An overview of chatbot technology,” in IFIP international conference on artificial intelligence applications and innovations, 2020, pp. 373–383.
V. Vijayaraghavan, J. B. Cooper, and others, “Algorithm inspection for chatbot performance evaluation,” Procedia Comput Sci, vol. 171, pp. 2267–2274, 2020.
C. Nalini, R. S. Kumari, G. K. Parteban, T. N. Priyaa, and A. S. Sanchay, “AI based chatbot in food industry,” in AIP Conference Proceedings, 2021.
J.-S. Chen, T.-T.-Y. Le, and D. Florence, “Usability and responsiveness of artificial intelligence chatbot on online customer experience in e-retailing,” International Journal of Retail & Distribution Management, vol. 49, no. 11, pp. 1512–1531, 2021.
B. A. Shawar and E. Atwell, “Chatbots: are they really useful?,” Journal for Language Technology and Computational Linguistics, vol. 22, no. 1, pp. 29–49, 2007.
M.-H. Su, C.-H. Wu, K.-Y. Huang, Q.-B. Hong, and H.-M. Wang, “A chatbot using LSTM-based multi-layer embedding for elderly care,” in 2017 International Conference on Orange Technologies (ICOT), 2017, pp. 70–74.
J. Zhang, Y. J. Oh, P. Lange, Z. Yu, and Y. Fukuoka, “Artificial intelligence chatbot behavior change model for designing artificial intelligence chatbots to promote physical activity and a healthy diet,” J Med Internet Res, vol. 22, no. 9, p. e22845, 2020.
S. Abuse and H. I. V Prevention, “Department of Health and Human Services Substance Abuse and Mental Health Services Administration”.
P. Muangkammuen, N. Intiruk, and K. R. Saikaew, “Automated thai-faq chatbot using rnn-lstm,” in 2018 22nd International Computer Science and Engineering Conference (ICSEC), 2018, pp. 1–4.
C. V. Misischia, F. Poecze, and C. Strauss, “Chatbots in customer service: Their relevance and impact on service quality,” Procedia Comput Sci, vol. 201, pp. 421–428, 2022.
E. W. T. Ngai, M. C. M. Lee, M. Luo, P. S. L. Chan, and T. Liang, “An intelligent knowledge-based chatbot for customer service,” Electron Commer Res Appl, vol. 50, p. 101098, 2021.
I. Hasan, S. Rizvi, S. Jain, and S. Huria, “The AI enabled Chatbot Framework for Intelligent Citizen-Government Interaction for Delivery of Services,” in 2021 8th International Conference on Computing for Sustainable Global Development (INDIACom), 2021, pp. 601–606.
I. M. De Andrade and C. Tumelero, “Increasing customer service efficiency through artificial intelligence chatbot,” Revista de Gestão, vol. 29, no. 3, pp. 238–251, 2022.
M. Skjuve, A. Følstad, K. I. Fostervold, and P. B. Brandtzaeg, “My chatbot companion-a study of human-chatbot relationships,” Int J Hum Comput Stud, vol. 149, p. 102601, 2021.
Y. D. Prabowo, H. L. H. S. Warnars, W. Budiharto, A. I. Kistijantoro, Y. Heryadi, and others, “Lstm and simple rnn comparison in the problem of sequence to sequence on conversation data using bahasa indonesia,” in 2018 Indonesian association for pattern recognition international conference (INAPR), 2018, pp. 51–56.
I. Tsidylo, S. Samborskiy, S.-I. Mazur, and M. Zamoroz, “Designing a Chat Bot for Learning a Subject in a Telegram Messenger.,” in ICTERI Workshops, 2020, pp. 1329–1340.
B. Horn, Robot vision. MIT press, 1986.
G. Veruggio, “The euron roboethics roadmap,” in 2006 6th IEEE-RAS international conference on humanoid robots, 2006, pp. 612–617.
N. Darapaneni et al., “Customer support Chatbot for electronic components,” in 2022 Interdisciplinary Research in Technology and Management (IRTM), 2022, pp. 1–7.
S. Naveen, “AUTOMATED CHATBOT IMPLEMENTED USING NATURAL LANGUAGE PROCESSING”.
K. Sarakhman, R. Kempnyk, and V. Chyhura, “ChatBot using NLP,” in Computational linguistics and intelligent systems: proceedings of the 4nd International conference (2), 2020, 2020, pp. 429–432.
D. Sai Pranav, M. Mutreja, D. Punj, and P. Chawla, “Natural Language Processing in Chatbots,” in Emerging Technologies in Data Mining and Information Security: Proceedings of IEMIS 2022, Volume 1, Springer, 2022, pp. 87–98.
E. Kasthuri and S. Balaji, “Natural language processing and deep learning chatbot using long short term memory algorithm,” Mater Today Proc, 2021.
M. Aleedy, H. Shaiba, and M. Bezbradica, “Generating and analyzing chatbot responses using natural language processing,” International Journal of Advanced Computer Science and Applications, vol. 10, no. 9, 2019.
V. Tiwari, L. K. Verma, P. Sharma, R. Jain, and P. Nagrath, “Neural network and NLP based chatbot for answering COVID-19 queries,” International Journal of Intelligent Engineering Informatics, vol. 9, no. 2, pp. 161–175, 2021.
S. Ayanouz, B. A. Abdelhakim, and M. Benhmed, “A smart chatbot architecture based NLP and machine learning for health care assistance,” in Proceedings of the 3rd international conference on networking, information systems & security, 2020, pp. 1–6.
R. Regin, S. S. Rajest, T. Shynu, and others, “An automated conversation system using natural language processing (nlp) chatbot in python,” Central Asian Journal of Medical and Natural Science, vol. 3, no. 4, pp. 314–336, 2022.
M. Mnasri, “Recent advances in conversational NLP: Towards the standardization of Chatbot building,” arXiv preprint arXiv:1903.09025, 2019.
T. Lalwani, S. Bhalotia, A. Pal, V. Rathod, and S. Bisen, “Implementation of a Chatbot System using AI and NLP,” International Journal of Innovative Research in Computer Science & Technology (IJIRCST) Volume-6, Issue-3, 2018.
P. Anki, A. Bustamam, H. S. Al-Ash, and D. Sarwinda, “Intelligent chatbot adapted from question and answer system using RNN-LSTM model,” in Journal of Physics: Conference Series, 2021, p. 12001.
K. Smagulova and A. P. James, “A survey on LSTM memristive neural network architectures and applications,” Eur Phys J Spec Top, vol. 228, no. 10, pp. 2313–2324, 2019.
Y. Yu, X. Si, C. Hu, and J. Zhang, “A review of recurrent neural networks: LSTM cells and network architectures,” Neural Comput, vol. 31, no. 7, pp. 1235–1270, 2019.
S. Hochreiter and J. Schmidhuber, “Long short-term memory,” Neural Comput, vol. 9, no. 8, pp. 1735–1780, 1997.
U. Naseem, I. Razzak, and P. W. Eklund, “A survey of pre-processing techniques to improve short-text quality: a case study on hate speech detection on twitter,” Multimed Tools Appl, vol. 80, pp. 35239–35266, 2021.
S. Imron, E. I. Setiawan, and J. Santoso, “Deteksi Aspek Review E-Commerce Menggunakan IndoBERT Embedding dan CNN,” INSYST: Journal of Intelligent System and Computation, vol. 5, no. 1, pp. 10–16, 2023.
S. Imron, E. I. Setiawan, J. Santoso, M. H. Purnomo, and others, “Aspect Based Sentiment Analysis Marketplace Product Reviews Using BERT, LSTM, and CNN,” Jurnal RESTI (Rekayasa Sistem dan Teknologi Informasi), vol. 7, no. 3, pp. 586–591, 2023.
DOI: https://doi.org/10.47738/jads.v4i4.128
Refbacks
- There are currently no refbacks.
Journal of Applied Data Sciences
| ISSN | : | 2723-6471 (Online) |
| Publisher | : | Bright Publisher |
| Website | : | http://bright-journal.org/JADS |
| : | taqwa@amikompurwokerto.ac.id (principal contact) | |
| support@bright-journal.org (technical issues) |
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0