.png)
Interpretable Temporal Risk Modeling for Contributor Inactivity Prediction: A Comparative Study of Tree-Based Ensembles
Abstract
This study aims to develop an interpretable temporal risk modeling framework for predicting contributor inactivity in collaborative development environments, thereby supporting sustained participation and improving productivity. The research focuses on contributor activity data collected from a collaborative software development platform, in which participation histories are represented by temporal engagement features that capture activity recency, participation intensity, and contribution patterns over time. To model inactivity risk, several tree-based ensemble learning algorithms, including Random Forest, XGBoost, LightGBM, and a stacking ensemble, are employed and evaluated under imbalanced classification conditions. Experimental results demonstrate strong predictive performance across models, with Random Forest achieving the highest AUC of 0.9401, while XGBoost obtains the best Matthews Correlation Coefficient (0.7353). The novelty of this study lies in prioritizing structured temporal behavioral representation through normalized temporal engagement features rather than increasing model complexity, enabling more interpretable inactivity risk modeling. The findings provide practical implications for collaborative platform managers by enabling early identification of contributor disengagement, supporting sustained participation, improving productivity, and facilitating continuous product innovation.
Keywords
Full Text:
PDFReferences
H. S. Qiu, A. Nolte, A. R. Brown, A. Serebrenik, and B. Vasilescu, "Going Farther Together: The Impact of Social Capital on Sustained Participation in Open Source," in Proc. 2019 IEEE/ACM 41st Int. Conf. on Software Engineering (ICSE), 2019, pp. 688-699, doi: 10.1109/ICSE.2019.00078.
J. Dearing, S. M. Greene, W. Stewart, and A. Williams, "If We Only Knew What We Know: Principles for Knowledge Sharing Across People, Practices, and Platforms," Translational Behavioral Medicine, vol. 1, no. 1, pp. 15-25, 2011, doi: 10.1007/s13142-010-0012-0.
J. Zhu, L. Ma, W. Wei, and B. Zhu, "A Study on the Governance Mechanism of Open-Source Platform Ecosystem From the Perspective of Stakeholders," Managerial and Decision Economics, 2025, doi: 10.1002/mde.70031.
B. Obrenovic, J. Du, D. Godinic, D. Tsoy, M. A. S. Khan, and I. J. Jakhongirov, "Sustaining Enterprise Operations and Productivity during the COVID-19 Pandemic: Enterprise Effectiveness and Sustainability Model," Sustainability, vol. 12, no. 15, Art. no. 5981, 2020, doi: 10.3390/su12155981.
R. Espinosa, G. Sánchez, J. Palma, and F. Jiménez, "Multi-objective evolutionary feature selection for ensemble learning with random forests in time series forecasting," Swarm and Evolutionary Computation, vol. 99, Art. no. 102211, Dec. 2025, doi: 10.1016/j.swevo.2025.102211.
P. Chen and X. Yang, "Premature casual carpooling in Texas: analyzing customer churn in the Metropia experiment with survival analysis and machine learning," Case Studies on Transport Policy, vol. 22, Art. no. 101587, Dec. 2025, doi: 10.1016/j.cstp.2025.101587.
T. Kavzoglu and A. Teke, "Predictive performances of ensemble machine learning algorithms in landslide susceptibility mapping using random forest, extreme gradient boosting (XGBoost) and natural gradient boosting (NGBoost)," Arabian Journal for Science and Engineering, vol. 47, no. 6, pp. 7367-7385, 2022, doi: 10.1007/s13369-022-06560-8.
H. Li, J. Xiao, L. Gan, and K. Liu, "Prediction of navigation aid malfunction based on hash chain-optimized FP-growth and gradient boosting random forest," Reliability Engineering & System Safety, vol. 269, Art. no. 112046, 2026, doi: 10.1016/j.ress.2025.112046.
A. Ahmed, X. Zeng, R. Xi, M. Hou, M. Afzal, and S. A. Shah, "Identifying pertinent cohorts and addressing imbalance for robust intensive care survival analysis," Engineering Applications of Artificial Intelligence, vol. 135, Art. no. 114267, 2026, doi: 10.1016/j.engappai.2026.114267.
A. Yadav, V. Srivastava, and A. Yadav, "Guided relevance attention mapping: Explainable artificial intelligence reimagined," Engineering Applications of Artificial Intelligence, vol. 132, Art. no. 112925, 2025, doi: 10.1016/j.engappai.2025.112925.
M. A. W. Nazri and T. R. Razak, "Towards deployable and explainable deep learning models for paddy leaf disease classification in R: A comparative study of CNN architectures with SHAP and LIME," Expert Systems with Applications, vol. 249, Art. no. 130337, 2025, doi: 10.1016/j.eswa.2025.130337.
M. Schröer, "A data-driven entropy-based approach to analyzing power shifts in organizational decision-making," Data Analytics Journal, vol. 5, Art. no. 100678, 2026, doi: 10.1016/j.dajour.2026.100678.
M. Zhu, L. Liu, and C. Su, "Breaking boundaries: Investigating the formation of cross-domain collaboration on social media platforms," Decision Support Systems, vol. 185, Art. no. 114574, 2025, doi: 10.1016/j.dss.2025.114574.
B. I. Adekunle, E. C. Chukwuma-Eke, E. D. Balogun, and K. O. Ogunsola, "Improving customer retention through machine learning: A predictive approach to churn prevention and engagement strategies," International Journal of Scientific Research in Computer Science, Engineering and Information Technology, vol. 9, no. 4, pp. 507-523, 2023.
A. K. Srivastava and D. Patnaik, "Data-driven insights and predictive modelling for employee attrition: A comprehensive analysis using statistical and machine learning techniques," Journal of Computational Analysis & Applications, vol. 34, no. 1, 2025.
E. Kaya, X. Dong, Y. Suhara, S. Balcisoy, and B. Bozkaya, "Behavioral attributes and financial churn prediction," EPJ Data Science, vol. 7, no. 1, Art. no. 41, 2018, doi: 10.1140/epjds/s13688-018-0161-6.
S. Uddin, A. Khan, M. E. Hossain, and M. A. Moni, "Comparing different supervised machine learning algorithms for disease prediction," BMC Medical Informatics and Decision Making, vol. 19, no. 1, Art. no. 281, 2019, doi: 10.1186/s12911-019-1004-8.
X. Ma, L. Khansa, and S. S. Kim, "Active community participation and crowdworking turnover: A longitudinal model and empirical test of three mechanisms," Journal of Management Information Systems, vol. 35, no. 4, pp. 1154-1187, 2018, doi: 10.1080/07421222.2018.1520779.
C. Miller, D. G. Widder, C. Kästner, and B. Vasilescu, "Why do people give up flossing? A study of contributor disengagement in open source," in IFIP International Conference on Open Source Systems, Cham, Switzerland: Springer, 2019, pp. 116-129.
N. Rane, S. P. Choudhary, and J. Rane, "Ensemble deep learning and machine learning: Applications, opportunities, challenges, and future directions," Studies in Medical and Health Sciences, vol. 1, no. 2, pp. 18-41, 2024.
Z. Zhou, C. Qiu, and Y. Zhang, "A comparative analysis of linear regression, neural networks and random forest regression for predicting air ozone employing soft sensor models," Scientific Reports, vol. 13, no. 1, Art. no. 22420, 2023, doi: 10.1038/s41598-023-49312-7.
M. Pratama, F. El Hakim, D. A. Syahputra, D. Dermawan, A. Asmunin, S. Nudin, and A. Nurhidayat, "Hybrid Transformer-XGBOOST model optimized with ant colony algorithm for early heart disease detection: A risk factor-driven and interpretable method," Journal of Applied Data Sciences, vol. 7, no. 1, pp. 148-164, 2025, doi: 10.47738/jads.v7i1.969.
L. Afuan and R. Isnanto, "Enhanced fall detection using optimized random forest classifier on wearable sensor data," Journal of Applied Data Sciences, vol. 6, no. 1, pp. 213-224, 2024, doi: 10.47738/jads.v6i1.498.
M. Jaxa-Rozen and J. Kwakkel, "Tree-based ensemble methods for sensitivity analysis of environmental models: A performance comparison with Sobol and Morris techniques," Environmental Modelling & Software, vol. 107, pp. 245-266, 2018, doi: 10.1016/j.envsoft.2018.06.011.
M. Sakib, S. Mustajab, and M. Alam, "Ensemble deep learning techniques for time series analysis: A comprehensive review, applications, open issues, challenges, and future directions," Cluster Computing, vol. 28, no. 1, Art. no. 73, 2025, doi: 10.1007/s10586-024-04575-4.
M. Vara, "Application of data science and predictive models for churn prevention: Optimizing customer retention," 2025.
M. Imani, M. Joudaki, A. Beikmohammadi, and H. R. Arabnia, "Customer churn prediction: A systematic review of recent advances, trends, and challenges in machine learning and deep learning," Machine Learning and Knowledge Extraction, vol. 7, no. 3, Art. no. 105, 2025, doi: 10.3390/make7030105.
L. Motus, M. Meriste, and W. Dosch, "Time-awareness and proactivity in models of interactive computation," Electronic Notes in Theoretical Computer Science, vol. 141, no. 5, pp. 69-95, 2005, doi.org/10.1016/j.entcs.2005.05.017.
H. L. Buckley, N. J. Day, G. Lear, and B. S. Case, "Changes in the analysis of temporal community dynamics data: A 29-year literature review," PeerJ, vol. 9, Art. no. e11250, 2021, doi: 10.7717/peerj.11250.
Y. Jayaram and D. Sundar, "Enhanced predictive decision models for academia and operations through advanced analytical methodologies," International Journal of Artificial Intelligence, Data Science, and Machine Learning, vol. 3, no. 4, pp. 113-122, 2022. doi.org/10.63282/3050-9262.IJAIDSML-V3I4P113
D. Minh, H. X. Wang, Y. F. Li, and T. N. Nguyen, "Explainable artificial intelligence: A comprehensive review," Artificial Intelligence Review, vol. 55, no. 5, pp. 3503-3568, 2022, doi: 10.1007/s10462-021-10088-y.
S. R. A. Parisineni and M. Pal, "Enhancing trust and interpretability of complex machine learning models using local interpretable model-agnostic SHAP explanations," International Journal of Data Science and Analytics, vol. 18, no. 4, pp. 457-466, 2024, doi.org/10.1007/s41060-023-00458-w.
B. Badhon, R. K. Chakrabortty, S. G. Anavatti, and M. Vanhoucke, "A multi-module explainable artificial intelligence framework for project risk management: Enhancing transparency in decision-making," Engineering Applications of Artificial Intelligence, vol. 148, Art. no. 110427, 2025, doi: 10.1016/j.engappai.2025.110427.
DOI: https://doi.org/10.47738/jads.v7i2.1311
Refbacks
- There are currently no refbacks.
Journal of Applied Data Sciences
| ISSN | : | 2723-6471 (Online) |
| Publisher | : | Bright Publisher |
| Website | : | http://bright-journal.org/JADS |
| : | taqwa@amikompurwokerto.ac.id (principal contact) | |
| support@bright-journal.org (technical issues) |
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0