Acceptance and Success Model for AI Use in Higher Education: Development, Instrument Decomposition, and Its Triangulation Testing

Abstract

Prior social computing studies described that the performance of technology products is about how the product use benefits the users, including Artificial Intelligence (AI). To have an impact, ensuring how AI is used is a prerequisite after the development. Furthermore, its use is also influenced by how users accept AI. This study aimed to develop an acceptance and success model of AI use in the higher education world from the user perspective, to decompose the model into its instrument level, and to test the validity and reliability of the research instrument. The researchers developed the model by adopting and combining the Technology Acceptance Model (TAM) and the Information System Success Model (ISSM) and adapting the proposed model in the context of AI use in higher education learning. The measurement items were derived from definitions of the variables and indicators of the model. The instrument was tested sequentially using triangulation methods. The quantitative testing was online survey with about 51 respondents and the qualitative one was interview involving five experts. This study may contribute methodologically as one of the guidance for novice scholars in similar works. It may relate to the clarity of the research procedure and the implementation of the mixed testing methods. Of course, the assumptions, samples, and data used in the study cannot be generalized for the other studies. Referring to the model development, the proposed model may not cover the other factors related to the ethical, cultural, and organizational barriers for adopting AI. These barriers may also affect its acceptance and success. Thus, the adoption of the factors related the barriers may also be interesting to study further.