Application of Stacking Ensemble Learning for Classifying Patient Revisit Patterns in Primary Healthcare Facilities
Abstract
The increasing volume of patient visits in primary healthcare facilities (such as community health centers and clinics) demands efficient resource management and scheduling systems. The inability to predict patient arrival patterns often leads to long queues and suboptimal allocation of medical personnel. To overcome these issues, this study proposes the development of an intelligent framework based on Stacking Ensemble Learning to accurately classify and predict patient revisit frequency patterns. The proposed architecture integrates three heterogeneous base classification models (base learners), namely Logistic Regression (LR), Support Vector Machine (SVM) with non-linear Radial Basis Function (RBF) kernel projection, and Random Forest (RF). The probability predictions from these three base models are then combined into a secondary Logistic Regression based meta-learner to optimize the final decision and reduce the predictive bias of single models. Experiments were conducted using a dataset sourced from actual primary healthcare medical records, totaling 499 data entries. Given the highly imbalanced distribution of demographic data, the preprocessing stages were comprehensively designed, encompassing numerical scale feature standardization and the application of the SMOTE (Synthetic Minority Oversampling Technique) class balancing algorithm. Model testing was performed using a 5-fold stratified cross-validation scheme to ensure the robustness of the model's generalization. Comprehensive evaluation results proved that the Stacking Ensemble architecture achieved peak performance with an Accuracy of 88.4%, Precision of 85%, Recall of 90%, and an F1-Score of 0.88. Furthermore, curve analysis revealed an Area Under the Receiver Operating Characteristic (AUC-ROC) score of 0.961 and a Precision-Recall AUC of 0.95, consistently outperforming the capabilities of each individual baseline model. These findings confirm that combining hybrid machine learning models can produce highly stable and reliable predictions while minimizing false negative errors. This architecture holds massive potential for practical implementation as the foundation of a decision support system in managing operational services within primary healthcare facilities.
Keywords
Views & Downloads Statistics (Last 12 Months)
References
29 References-
[1]World Health Organization, "Primary Health Care: Transforming Vision into Action," WHO Technical Series, 2021. doi:10.2471/BLT.21.286903
-
[2]A. Rajkomar, J. Dean, dan I. Kohane, "Machine Learning in Medicine," New England Journal of Medicine, vol. 380, no. 14, pp. 1347–1358, 2021. ISSN: 0028-4793. doi:10.1056/NEJMra1814259
-
[3]S. Gedam dan S. Paul, "A Review on Mental Stress Detection Using Wearable Sensors dan Machine Learning Techniques," IEEE Access, vol. 9, pp. 84045–84066, 2021. ISSN: 2169-3536. doi:10.1109/ACCESS.2021.3085502
-
[4]H. Abdul Rahman, et al., "Machine Learning-Based Prediction of Mental Well-Being Using Health Behavior Data from University Students," Bioengineering, vol. 10, no. 5, p. 575, 2023. ISSN: 2306-5354. doi:10.3390/bioengineering10050575
-
[5]N. Pudjihartono, T. Fadason, A. W. Kempa-Liehr, dan J. M. O'Sullivan, "A Review of Feature Selection Methods for Machine Learning-Based Disease Risk Prediction," Frontiers in Bioinformatics, vol. 2, p. 927312, 2022. ISSN: 2673-7647. doi:10.3389/fbinf.2022.927312
-
[6]A. B. R. Shatte, D. M. Hutchinson, dan S. J. Teague, "Machine Learning in Mental Health: A Scoping Review of Methods and Applications," Psychological Medicine, vol. 49, no. 9, pp. 1426–1448, 2019. ISSN: 0033-2917. doi:10.1017/S0033291719000151
-
[7]R. Chowdhury, W. Xuan, S. Sen, Y. Zhao, dan Y. Ding, "Predicting and Understanding College Student Mental Health with Interpretable Machine Learning," arXiv preprint, arXiv:2503.08002, 2025. doi:10.48550/arXiv.2503.08002
-
[8]G. Stiglic, et al., "Interpretability of Machine Learning-Based Prediction Models in Healthcare," WIREs Data Mining and Knowledge Discovery, vol. 10, no. 5, e1379, 2020. ISSN: 1942-4795. doi:10.1002/widm.1379
-
[9]I. D. Mienye dan Y. Sun, "A Survey of Ensemble Learning: Concepts, Algorithms, Applications, dan Prospects," IEEE Access, vol. 10, pp. 99129–99149, 2022. ISSN: 2169-3536. doi:10.1109/ACCESS.2022.3207287
-
[10]M. Ali, et al., "A Survey on Ensemble Learning Techniques," ACM Computing Surveys, vol. 54, no. 2, pp. 1–36, 2021. ISSN: 0360-0300. doi:10.1145/3439726
-
[11]Fadila Khairani, dkk., "Stacking Ensemble Learning Mengintegrasikan LR, SVM, dan RF untuk Prediksi Depresi pada Mahasiswa," Journal of Science and Social Research, vol. VII, no. 3, pp. 4256–4266, 2024. ISSN: 2615-4307 (Print) / 2615-3262 (Online).
-
[12]J. Chung dan J. Teo, "Single Classifier vs. Ensemble Machine Learning Approaches for Mental Health Prediction," Brain Informatics, vol. 10, no. 1, pp. 1–10, 2023. ISSN: 2198-4018. doi:10.1186/s40708-022-00180-6
-
[13]D. Imans, T. Abuhmed, M. Alharbi, dan S. El-Sappagh, "Explainable Multi-Layer Dynamic Ensemble Framework Optimized for Depression Detection and Severity Assessment," Diagnostics, vol. 14, no. 21, p. 2385, 2024. ISSN: 2075-4418. doi:10.3390/diagnostics14212385
-
[14]M. Habib, et al., "Ensemble Machine Learning Approaches for Prediction of Patient Outcomes in Healthcare: A Comprehensive Review," Artificial Intelligence in Medicine, vol. 145, p. 102690, 2023. ISSN: 0933-3657. doi:10.1016/j.artmed.2023.102690
-
[15]S. Uddin, et al., "Comparative Performance Analysis of K-Nearest Neighbour (KNN) Algorithm and its Different Variants for Disease Prediction," Scientific Reports, vol. 12, p. 6256, 2022. ISSN: 2045-2322. doi:10.1038/s41598-022-10358-x
-
[16]B. Mahesh, "Machine Learning Algorithms — A Review," International Journal of Science and Research, vol. 9, no. 1, pp. 381–386, 2022. ISSN: 2319-7064. doi:10.21275/ART20203995
-
[17]K. M. Ting dan I. H. Witten, "Issues in Stacked Generalization," Journal of Artificial Intelligence Research, vol. 10, pp. 271–289, 1999. ISSN: 1076-9757. doi:10.1613/jair.594
-
[18]N. V. Chawla, K. W. Bowyer, L. O. Hall, dan W. P. Kegelmeyer, "SMOTE: Synthetic Minority Over-sampling Technique," Journal of Artificial Intelligence Research, vol. 16, pp. 321–357, 2002. ISSN: 1076-9757. doi:10.1613/jair.953
-
[19]A. Alotaibi, "Ensemble Deep Learning Approaches in Health Care: A Review," Computers, Materials and Continua, vol. 82, no. 3, pp. 3741–3771, 2025. ISSN: 1546-2226. doi:10.32604/cmc.2025.061998
-
[20]A. Aman dan R. S. Chhillar, "A Stacking-based Hybrid Model with Random Forest as Meta-learner for Diabetes Mellitus Prediction," International Journal of Machine Learning, vol. 14, no. 2, pp. 54–58, 2024. ISSN: 2180-1339.
-
[21]A. Alanazi, "Stack Ensemble Model for ICU Length of Stay Prediction," Engineering, Technology and Applied Science Research, vol. 15, no. 1, pp. 19878–19883, 2025. ISSN: 2241-4487. doi:10.48084/etasr.9462 [22] F. Rustam, et al., "Classification of Heart Disease Using Stacking Ensemble Learning Framework," Journal of Personalized Medicine, vol. 15, no. 3, p. 215, 2025. ISSN: 2075-4426. doi:10.3390/jpm15030215
-
[22]M. A. Al-Garadi, et al., "A Survey of Machine Learning-Based Approaches for Predicting Hospital Readmissions," International Journal of Medical Informatics, vol. 171, p. 104988, 2023. ISSN: 1386-5056. doi:10.1016/j.ijmedinf.2023.104988
-
[23]S. Islam, et al., "Stacked Deep Ensemble Learning for Cancer Type Classification Using Multi-Omics Data Integration," JMIR Bioinformatics and Biotechnology, vol. 6, p. e63526, 2025. ISSN: 2691-8439. doi:10.2196/63526
-
[24]O. M. Alade, et al., "Healthcare Risk Prediction Using Stacked Ensemble Learning," International Journal of Science and Research Archive, vol. 11, no. 1, pp. 2612–2624, 2024. ISSN: 2582-8185. doi:10.30574/ijsra.2024.11.1.0204
-
[25]Y. Liu, et al., "Predicting Hospital Readmission Using Machine Learning Methods: A Systematic Review," JAMIA Open, vol. 6, no. 3, p. ooad062, 2023. ISSN: 2574-2531. doi:10.1093/jamiaopen/ooad062
-
[26]W. Cao, et al., "The Psychological Impact of the COVID-19 Epidemic on College Students in China," Psychiatry Research, vol. 287, p. 112934, 2020. ISSN: 0165-1781. doi:10.1016/j.psychres.2020.112934
-
[27]M. Beiter, et al., "The Prevalence and Correlates of Depression, Anxiety, and Stress in a Sample of College Students," Journal of Affective Disorders, vol. 173, pp. 90–96, 2015. ISSN: 0165-0327. doi:10.1016/j.jad.2014.10.054
-
[28]C. S. Conley, J. A. Durlak, dan D. A. Dickson, "An Evaluative Review of Outcome Research on Universal Mental Health Promotion Programs," Journal of American College Health, vol. 61, no. 5, pp. 286–301, 2013. ISSN: 0744-8481. doi:10.1080/07448481.2013.802237
-
[29]A. Reupert, et al., "Student Mental Health and Well-being: Research Findings and Recommendations," International Journal of Mental Health Promotion, vol. 23, no. 4, pp. 541–560, 2021. ISSN: 1462-3730. doi:10.32604/ijmhp.2021.018035
