.png)
Acceptance and Success Model for AI Use in Higher Education: Development, Instrument Decomposition, and Its Triangulation Testing
Abstract
Prior social computing studies described that the performance of technology products is about how the product use benefits the users, including Artificial Intelligence (AI). To have an impact, ensuring how AI is used is a prerequisite after the development. Furthermore, its use is also influenced by how users accept AI. This study aimed to develop an acceptance and success model of AI use in the higher education world from the user perspective, to decompose the model into its instrument level, and to test the validity and reliability of the research instrument. The researchers developed the model by adopting and combining the Technology Acceptance Model (TAM) and the Information System Success Model (ISSM) and adapting the proposed model in the context of AI use in higher education learning. The measurement items were derived from definitions of the variables and indicators of the model. The instrument was tested sequentially using triangulation methods. The quantitative testing was online survey with about 51 respondents and the qualitative one was interview involving five experts. This study may contribute methodologically as one of the guidance for novice scholars in similar works. It may relate to the clarity of the research procedure and the implementation of the mixed testing methods. Of course, the assumptions, samples, and data used in the study cannot be generalized for the other studies. Referring to the model development, the proposed model may not cover the other factors related to the ethical, cultural, and organizational barriers for adopting AI. These barriers may also affect its acceptance and success. Thus, the adoption of the factors related the barriers may also be interesting to study further.
Keywords
Full Text:
PDFReferences
T. K. F. Chiu, Q. Xia, X. Zhou, C. S. Chai, and M. Cheng, "Systematic literature review on opportunities, challenges, and future research recommendations of artificial intelligence in education," Computers and Education: Artificial Intelligence, vol. 4, p. 100118, 2023/01/01/ 2023, doi: https://doi.org/10.1016/j.caeai.2022.100118.
R. C. Climent, D. M. Haftor, and M. W. Staniewski, "AI-enabled business models for competitive advantage," Journal of Innovation & Knowledge, vol. 9, no. 3, p. 100532, 2024/07/01/ 2024, doi: https://doi.org/10.1016/j.jik.2024.100532.
Z. Jin, S. B. Goyal, and A. S. Rajawat, "The Informational Role of Artificial Intelligence in Higher Education in the New Era," Procedia Computer Science, vol. 235, pp. 1008-1023, 2024/01/01/ 2024, doi: https://doi.org/10.1016/j.procs.2024.04.096.
K. S. Suryanarayana, V. S. P. Kandi, G. Pavani, A. S. Rao, S. Rout, and T. Siva Rama Krishna, "Artificial Intelligence Enhanced Digital Learning for the Sustainability of Education Management System," The Journal of High Technology Management Research, vol. 35, no. 2, p. 100495, 2024/11/01/ 2024, doi: https://doi.org/10.1016/j.hitech.2024.100495.
S. Wang, F. Wang, Z. Zhu, J. Wang, T. Tran, and Z. Du, "Artificial intelligence in education: A systematic literature review," Expert Systems with Applications, vol. 252, p. 124167, 2024/10/15/ 2024, doi: https://doi.org/10.1016/j.eswa.2024.124167.
A. O. Tzirides et al., "Combining human and artificial intelligence for enhanced AI literacy in higher education," Computers and Education Open, vol. 6, p. 100184, 2024/06/01/ 2024, doi: https://doi.org/10.1016/j.caeo.2024.100184.
M. C. Laupichler, A. Aster, J. Schirch, and T. Raupach, "Artificial intelligence literacy in higher and adult education: A scoping literature review," Computers and Education: Artificial Intelligence, vol. 3, p. 100101, 2022/01/01/ 2022, doi: https://doi.org/10.1016/j.caeai.2022.100101.
W. Sun, A. Tohirovich Dedahanov, W. P. Li, and H. Young Shin, "Sanctions and opportunities: Factors affecting China's high-tech SMEs adoption of artificial intelligence computing leasing business," Heliyon, vol. 10, no. 16, p. e36620, 2024/08/30/ 2024, doi: https://doi.org/10.1016/j.heliyon.2024.e36620.
J. Varajão, J. C. Lourenço, and J. Gomes, "Models and methods for information systems project success evaluation – A review and directions for research," Heliyon, vol. 8, no. 12, p. e11977, 2022/12/01/ 2022, doi: https://doi.org/10.1016/j.heliyon.2022.e11977.
F. Sunmola and G. L. Lawrence, "Key Success Factors for Integration of Blockchain and ERP Systems: A Systematic Literature Review," Procedia Computer Science, vol. 232, pp. 775-782, 2024/01/01/ 2024, doi: https://doi.org/10.1016/j.procs.2024.01.077.
G. Tetik, S. Türkeli, S. Pinar, and M. Tarim, "Health information systems with technology acceptance model approach: A systematic review," International Journal of Medical Informatics, vol. 190, p. 105556, 2024/10/01/ 2024, doi: https://doi.org/10.1016/j.ijmedinf.2024.105556.
C. Wang et al., "An empirical evaluation of technology acceptance model for Artificial Intelligence in E-commerce," Heliyon, vol. 9, no. 8, p. e18349, 2023/08/01/ 2023, doi: https://doi.org/10.1016/j.heliyon.2023.e18349.
S. C. Kong, Y. Yang, and C. Hou, "Examining teachers' behavioral intention of using generative artificial intelligence tools for teaching and learning based on the extended technology acceptance model," Computers and Education: Artificial Intelligence, p. 100328, 2024/11/01/ 2024, doi: https://doi.org/10.1016/j.caeai.2024.100328.
O. Antsygina, S. Rollo, N. McRae, J.-P. Chaput, and M. S. Tremblay, "Reliability and validity of instruments containing reported sleep measures among children from birth to <5 years of age: A systematic review," Sleep Medicine Reviews, vol. 79, p. 102023, 2025/02/01/ 2025, doi: https://doi.org/10.1016/j.smrv.2024.102023.
J. A. M. Bom, D. C. Voormolen, W. B. F. Brouwer, E. W. de Bekker-Grob, and J. van Exel, "Construct Validity, Reliability, and Responsiveness of the 10-Item Well-Being Instrument for Use in Economic Evaluation Studies," Value in Health, vol. 27, no. 7, pp. 871-878, 2024/07/01/ 2024, doi: https://doi.org/10.1016/j.jval.2024.02.014.
P. M. Gee, A. Clift, J. Osteyee, E. B. P. C. R. Katz, and D. Collingridge, "Fall risk instrument for pediatric behavioral health patients (BHFR-P©): A validity and reliability study," Journal of Pediatric Nursing, vol. 69, pp. 118-120, 2023/03/01/ 2023, doi: https://doi.org/10.1016/j.pedn.2023.02.011.
C. Wallwey and R. L. Kajfez, "Quantitative research artifacts as qualitative data collection techniques in a mixed methods research study," Methods in Psychology, vol. 8, p. 100115, 2023/11/01/ 2023, doi: https://doi.org/10.1016/j.metip.2023.100115.
H. Taherdoost, "What are different research approaches? Comprehensive Review of Qualitative, quantitative, and mixed method research, their applications, types, and limitations," Journal of Management Science & Engineering Research, vol. 5, no. 1, pp. 53-63, 2022.
J. Hair and A. Alamer, "Partial Least Squares Structural Equation Modeling (PLS-SEM) in second language and education research: Guidelines using an applied example," Research Methods in Applied Linguistics, vol. 1, no. 3, p. 100027, 2022/12/01/ 2022, doi: https://doi.org/10.1016/j.rmal.2022.100027.
R. M. Belcher, B. Shultz, J. Mucksavage, E. Herrera, and S. Benken, "Qualitative analysis of preparation and planning habits of students with low-performance on high-stakes practice examinations (pre-NAPLEX®)," Currents in Pharmacy Teaching and Learning, vol. 16, no. 10, p. 102160, 2024/10/01/ 2024, doi: https://doi.org/10.1016/j.cptl.2024.102160.
A. Subiyakto, R. Rosalina, M. C. Utami, N. Kumaladewi, and S. J. Putra, "The psychometric and interpretative analyses for assessing the end-user computing satisfaction questionnaire," in 2017 5th International Conference on Cyber and IT Service Management, CITSM 2017, 2017, doi: 10.1109/CITSM.2017.8089282. [Online]. Available: https://www.scopus.com/inward/record.uri?eid=2-s2.0-85040240851&doi=10.1109%2fCITSM.2017.8089282&partnerID=40&md5=5c867df40c5307baba9f6c7b08fc4109
A. Subiyakto, M. R. Juliansyah, M. C. Utami, and A. Susanto, "Combining the Statistical and Interpretative Analyses for Testing E-Commerce Customer Loyalty Questionnaire," in 2018 6th International Conference on Cyber and IT Service Management, CITSM 2018, 2019, doi: 10.1109/CITSM.2018.8674342. [Online]. Available: https://www.scopus.com/inward/record.uri?eid=2-s2.0-85064333229&doi=10.1109%2fCITSM.2018.8674342&partnerID=40&md5=cfd14537beb508bb3ffd21eb17b3f6d7
M. K. Al-Kofahi, H. Hassan, R. Mohamad, T. Intan, and M. Com, "Information systems success model: A review of literature," International Journal of Innovation, Creativity, and Change, vol. 12, no. 8, 2020.
I. Y. Alyoussef, "Acceptance of e-learning in higher education: The role of task-technology fit with the information systems success model," Heliyon, vol. 9, no. 3, p. e13751, 2023/03/01/ 2023, doi: https://doi.org/10.1016/j.heliyon.2023.e13751.
G. Banafo Akrong, S. Yunfei, and E. Owusu, "Development and validation of an improved DeLone-McLean IS success model - application to the evaluation of a tax administration ERP," International Journal of Accounting Information Systems, vol. 47, p. 100579, 2022/12/01/ 2022, doi: https://doi.org/10.1016/j.accinf.2022.100579.
A. Jeyaraj, "DeLone & McLean models of information system success: Critical meta-review and research directions," International Journal of Information Management, vol. 54, p. 102139, 2020/10/01/ 2020, doi: https://doi.org/10.1016/j.ijinfomgt.2020.102139.
Y. T. Prasetyo et al., "Determining factors Affecting acceptance of e-learning platforms during the COVID-19 pandemic: Integrating Extended technology Acceptance model and DeLone & Mclean is success model," Sustainability, vol. 13, no. 15, p. 8365, 2021.
A. Sulhi, N. A. B. Yahaya, and A. Subiyakto, "Acceptance of Information Technology Security Among Universities: a Model Development Study," Journal of Applied Data Sciences, Article vol. 4, no. 4, pp. 363-371, 2023, doi: 10.47738/jads.v4i4.142.
D. M. Eddy, W. Hollingworth, J. J. Caro, J. Tsevat, K. M. McDonald, and J. B. Wong, "Model Transparency and Validation: A Report of the ISPOR-SMDM Modeling Good Research Practices Task Force–7," Medical Decision Making, vol. 32, no. 5, pp. 733-743, 2012, doi: 10.1177/0272989x12454579.
DOI: https://doi.org/10.47738/jads.v6i4.619
Refbacks
- There are currently no refbacks.
Journal of Applied Data Sciences
| ISSN | : | 2723-6471 (Online) |
| Publisher | : | Bright Publisher |
| Website | : | http://bright-journal.org/JADS |
| : | taqwa@amikompurwokerto.ac.id (principal contact) | |
| support@bright-journal.org (technical issues) |
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0