The Integration of DEMATEL and SAW Methods for Developing a Research Performance Assessment Model for Lecturers

Muh. Nurtanzis Sutoyo, Alders Paliling

Abstract


This work aims to integrate two decision analytic methodologies, DEMATEL and SAW, to develop a comprehensive and effective model for assessing research performance among instructors. These strategies aim to rectify the deficiencies of traditional evaluation models, which often neglect the complexity of interconnections among performance metrics. This study utilizes research performance data from lecturers, encompassing publication count, journal quality, impact, funding, and cooperation. SAW is employed to calculate aggregate scores utilizing weights obtained from the DEMATEL analysis, whereas DEMATEL is utilized to delineate and assess the interrelationships among the evaluation criteria. The results indicate that the quantity of publications significantly influences research quality, succeeded by research impact and journal quality. Alternative A, with a maximum score of 0.996, demonstrated that the professor excelled in nearly all categories. A clear and objective evaluation methodology was developed by integrating DEMATEL with SAW. The development of more flexible criterion weights to accommodate shifts in academic practices and research priorities is a significant implication for future investigations. To evaluate this model's appropriateness and effectiveness in various academic contexts, it must be further assessed across multiple topic areas and types of educational institutions. This study facilitates the implementation of big data technology in academic performance evaluation, enhancing the accuracy and relevance of assessment methods.

Keywords


Academic Performance Evaluation; DEMATEL; SAW; MCDM; Faculty Research Performance

Full Text:

PDF

References


A. Andika, F. J. Y. Louwisia, C. F. Susilo, and A. Victoria, “Factors Affecting Indonesian Higher Education Institution Students’ Academic Achievement in the Industry 4.0 Era,” ELS J. Interdiscip. Stud. Humanit., vol. 4, no. 3, pp. 270–282, 2021, doi: 10.34050/elsjish.v4i3.15003.

W. Xu, “A Research on the Influence of College Student Time Management on Their Academic Development,” vol. 480, no. Mmet, pp. 104–109, 2020, doi: 10.2991/assehr.k.201023.019.

A. S. Griffith and Z. Altinay, “A framework to assess higher education faculty workload in U.S. universities,” Innov. Educ. Teach. Int., vol. 57, no. 6, pp. 691–700, 2020, doi: 10.1080/14703297.2020.1786432.

Lisnawita, F. C. Lucky Lhaura Van, Fajrizal, A. Zamsuri, and M. Syarawi, “Developing Decision Support System: Assessing the Lecturers’ Performance with Additive Weighting Method,” IOP Conf. Ser. Earth Environ. Sci., vol. 175, no. 1, 2018, doi: 10.1088/1755-1315/175/1/012100.

M. Isa Indrawan et al., “UNPAB Lecturer Assessment and Performance Model based on Indonesia Science and Technology Index,” J. Phys. Conf. Ser., vol. 1175, no. 1, 2019, doi: 10.1088/1742-6596/1175/1/012268.

M. Yazdi, F. Khan, R. Abbassi, and R. Rusli, “Improved DEMATEL methodology for effective safety management decision-making,” Saf. Sci., vol. 127, no. September 2019, p. 104705, 2020, doi: 10.1016/j.ssci.2020.104705.

S. L. Si, X. Y. You, H. C. Liu, and P. Zhang, “DEMATEL Technique: A Systematic Review of the State-of-the-Art Literature on Methodologies and Applications,” Math. Probl. Eng., vol. 2018, no. 1, 2018, doi: 10.1155/2018/3696457.

L. Rolita, B. Surarso, and R. Gernowo, “The Decision Making Trial and Evaluation Laboratory (Dematel) and Analytic Network Process (ANP) for Safety Management System Evaluation Performance,” E3S Web Conf., vol. 31, 2018, doi: 10.1051/e3sconf/20183112006.

H. Taherdoost, “Analysis of Simple Additive Weighting Method (SAW) as a MultiAttribute Decision-Making Technique: A Step-by-Step Guide,” J. Manag. Sci. Eng. Res., vol. 6, no. 1, pp. 21–24, 2023, doi: 10.30564/jmser.v6i1.5400.

Hamidah, O. Rizan, D. Wahyuningsih, H. A. Pradana, and S. Ramadella, “SAW Method in Supporting the Process of Admission of New Junior High School Students,” 2020 8th Int. Conf. Cyber IT Serv. Manag. CITSM 2020, 2020, doi: 10.1109/CITSM50537.2020.9268874.

M. Sousa, M. F. Almeida, and R. Calili, “Multiple criteria decision making for the achievement of the un sustainable development goals: A systematic literature review and a research agenda,” Sustain., vol. 13, no. 8, 2021, doi: 10.3390/su13084129.

A. E. Vasegaard, M. Picard, F. Hennart, P. Nielsen, and S. Saha, “Multi criteria decision making for the multi-satellite image acquisition scheduling problem,” Sensors (Switzerland), vol. 20, no. 5, pp. 1–23, 2020, doi: 10.3390/s20051242.

I. Emovon and O. S. Oghenenyerovwho, “Application of MCDM method in material selection for optimal design: A review,” Results Mater., vol. 7, no. June, p. 100115, 2020, doi: 10.1016/j.rinma.2020.100115.

G. Yannis, A. Kopsacheili, A. Dragomanovits, and V. Petraki, “State-of-the-art review on multi-criteria decision-making in the transport sector,” J. Traffic Transp. Eng. (English Ed., vol. 7, no. 4, pp. 413–431, 2020, doi: 10.1016/j.jtte.2020.05.005.

M. Dalvi-Esfahani, A. Niknafs, D. J. Kuss, M. Nilashi, and S. Afrough, “Social media addiction: Applying the DEMATEL approach,” Telemat. Informatics, vol. 43, p. 101250, 2019, doi: 10.1016/j.tele.2019.101250.

M. Sharma, S. Joshi, and A. Kumar, “Assessing enablers of e-waste management in circular economy using DEMATEL method: An Indian perspective,” Environ. Sci. Pollut. Res., vol. 27, no. 12, pp. 13325–13338, 2020, doi: 10.1007/s11356-020-07765-w.

M. Ortiz-Barrios, C. Miranda-De la Hoz, P. López-Meza, A. Petrillo, and F. De Felice, “A case of food supply chain management with AHP, DEMATEL, and TOPSIS,” J. Multi-Criteria Decis. Anal., vol. 27, no. 1–2, pp. 104–128, 2020, doi: 10.1002/mcda.1693.

Y. Li, A. Diabat, and C. C. Lu, “Leagile supplier selection in Chinese textile industries: a DEMATEL approach,” Ann. Oper. Res., vol. 287, no. 1, pp. 303–322, 2020, doi: 10.1007/s10479-019-03453-2.

R. D. Raut, B. B. Gardas, B. E. Narkhede, and V. S. Narwane, “To investigate the determinants of cloud computing adoption in the manufacturing micro, small and medium enterprises: A DEMATEL-based approach,” Benchmarking, vol. 26, no. 3, pp. 990–1019, 2019, doi: 10.1108/BIJ-03-2018-0060.

W. Song, Y. Zhu, and Q. Zhao, “Analyzing barriers for adopting sustainable online consumption: A rough hierarchical DEMATEL method,” Comput. Ind. Eng., vol. 140, p. 106279, 2020, doi: 10.1016/j.cie.2020.106279.

Y. W. Du and X. X. Li, “Hierarchical DEMATEL method for complex systems,” Expert Syst. Appl., vol. 167, no. March, p. 113871, 2021, doi: 10.1016/j.eswa.2020.113871.

A. Rasadi, B. Hidayat, and T. Ophiyandri, “Decision support system in determining the priority of disaster mitigation infrastructure development in villages level using the Simple Additive Weight (SAW) method,” IOP Conf. Ser. Earth Environ. Sci., vol. 708, no. 1, 2021, doi: 10.1088/1755-1315/708/1/012065.

E. Simanungkalit, J. S. Tarigan, D. C. Sari, and A. S. Hasibuan, “Implementation of Simple Additive Weighting (SAW) Method in Decision Support System to Determine the Best University in Medan,” Int. J. Res. Vocat. Stud., vol. 2, no. 4, pp. 168–172, 2023, doi: 10.53893/ijrvocas.v2i4.190.

Y. Irawan, “Decision Support System for Employee Bonus Determination With Web-Based Simple Additive Weighting (Saw) Method in Pt. Mayatama Solusindo,” J. Appl. Eng. Technol. Sci., vol. 2, no. 1, pp. 7–13, 2020, doi: 10.37385/jaets.v2i1.162.

S. G. Meshram, E. Alvandi, C. Meshram, E. Kahya, and A. M. Fadhil Al-Quraishi, “Application of SAW and TOPSIS in Prioritizing Watersheds,” Water Resour. Manag., vol. 34, no. 2, pp. 715–732, 2020, doi: 10.1007/s11269-019-02470-x.

D. Meidelfi, Yulherniwati, F. Sukma, D. Chandra, and A. H. Soleliza Jones, “The implementation of SAW and BORDA method to determine the eligibility of students’ final project topic,” Int. J. Informatics Vis., vol. 5, no. 2, pp. 144–149, 2021, doi: 10.30630/joiv.5.1.447.

N. Kumar, T. Singh, Grewal, A. Patnaik, and G. Fekete, “A novel hybrid AHP-SAW approach for optimal selection of natural fiber reinforced non-asbestos organic brake friction composites,” pp. 0–25, 2021.

M. Safaripour and N. R. Andabili, “Miyandoab flood risk mapping using dematel and saw methods and dpsir model,” Adv. Environ. Technol., vol. 6, no. 3, pp. 131–138, 2020, doi: 10.22104/AET.2020.4766.1287.

M. A. Kasri and H. Jati, “Combination of K-Means and Simple Additive Weighting in Deciding Locations and Strategies of University Marketing,” Khazanah Inform. J. Ilmu Komput. dan Inform., vol. 6, no. 2, pp. 132–141, 2020, doi: 10.23917/khif.v6i2.11281.

A. Fadlil, I. Riadi, and Y. Mulyana, “Integration of Fuzzy C-Means and SAW Methods on Education Fee Assistance Recipients,” Kinet. Game Technol. Inf. Syst. Comput. Network, Comput. Electron. Control, vol. 4, no. 2, 2023, doi: 10.22219/kinetik.v8i2.1636.




DOI: https://doi.org/10.47738/jads.v6i2.550

Refbacks

  • There are currently no refbacks.



Barcode

Journal of Applied Data Sciences

ISSN:2723-6471 (Online)
Publisher:Bright Publisher
Website:http://bright-journal.org/JADS
Email:taqwa@amikompurwokerto.ac.id (principal contact)
  support@bright-journal.org (technical issues)

This work is licensed under a Creative Commons Attribution-ShareAlike 4.0