Published: 28-09-2026

Application of Stacking Ensemble Learning for Classifying Patient Revisit Patterns in Primary Healthcare Facilities

Nasrun Marpaung
Universitas Royal
Indonesia
Author
Dewi Maharani
Universitas Royal
Indonesia
Author
Akmal Nasution
Universitas Royal
Indonesia
Author

Abstract

The increasing volume of patient visits in primary healthcare facilities (such as community health centers and clinics) demands efficient resource management and scheduling systems. The inability to predict patient arrival patterns often leads to long queues and suboptimal allocation of medical personnel. To overcome these issues, this study proposes the development of an intelligent framework based on Stacking Ensemble Learning to accurately classify and predict patient revisit frequency patterns. The proposed architecture integrates three heterogeneous base classification models (base learners), namely Logistic Regression (LR), Support Vector Machine (SVM) with non-linear Radial Basis Function (RBF) kernel projection, and Random Forest (RF). The probability predictions from these three base models are then combined into a secondary Logistic Regression based meta-learner to optimize the final decision and reduce the predictive bias of single models. Experiments were conducted using a dataset sourced from actual primary healthcare medical records, totaling 499 data entries. Given the highly imbalanced distribution of demographic data, the preprocessing stages were comprehensively designed, encompassing numerical scale feature standardization and the application of the SMOTE (Synthetic Minority Oversampling Technique) class balancing algorithm. Model testing was performed using a 5-fold stratified cross-validation scheme to ensure the robustness of the model's generalization. Comprehensive evaluation results proved that the Stacking Ensemble architecture achieved peak performance with an Accuracy of 88.4%, Precision of 85%, Recall of 90%, and an F1-Score of 0.88. Furthermore, curve analysis revealed an Area Under the Receiver Operating Characteristic (AUC-ROC) score of 0.961 and a Precision-Recall AUC of 0.95, consistently outperforming the capabilities of each individual baseline model. These findings confirm that combining hybrid machine learning models can produce highly stable and reliable predictions while minimizing false negative errors. This architecture holds massive potential for practical implementation as the foundation of a decision support system in managing operational services within primary healthcare facilities.

Keywords

stacking ensemble

Views & Downloads Statistics (Last 12 Months)

Monthly performance and trends of article views and downloads
views: 23 downloads: 27

References

29 References
Bibliography and cited literature of the article
  1. [1]
    World Health Organization, "Primary Health Care: Transforming Vision into Action," WHO Technical Series, 2021. doi:10.2471/BLT.21.286903
  2. [2]
    A. Rajkomar, J. Dean, dan I. Kohane, "Machine Learning in Medicine," New England Journal of Medicine, vol. 380, no. 14, pp. 1347–1358, 2021. ISSN: 0028-4793. doi:10.1056/NEJMra1814259
  3. [3]
    S. Gedam dan S. Paul, "A Review on Mental Stress Detection Using Wearable Sensors dan Machine Learning Techniques," IEEE Access, vol. 9, pp. 84045–84066, 2021. ISSN: 2169-3536. doi:10.1109/ACCESS.2021.3085502
  4. [4]
    H. Abdul Rahman, et al., "Machine Learning-Based Prediction of Mental Well-Being Using Health Behavior Data from University Students," Bioengineering, vol. 10, no. 5, p. 575, 2023. ISSN: 2306-5354. doi:10.3390/bioengineering10050575
  5. [5]
    N. Pudjihartono, T. Fadason, A. W. Kempa-Liehr, dan J. M. O'Sullivan, "A Review of Feature Selection Methods for Machine Learning-Based Disease Risk Prediction," Frontiers in Bioinformatics, vol. 2, p. 927312, 2022. ISSN: 2673-7647. doi:10.3389/fbinf.2022.927312
  6. [6]
    A. B. R. Shatte, D. M. Hutchinson, dan S. J. Teague, "Machine Learning in Mental Health: A Scoping Review of Methods and Applications," Psychological Medicine, vol. 49, no. 9, pp. 1426–1448, 2019. ISSN: 0033-2917. doi:10.1017/S0033291719000151
  7. [7]
    R. Chowdhury, W. Xuan, S. Sen, Y. Zhao, dan Y. Ding, "Predicting and Understanding College Student Mental Health with Interpretable Machine Learning," arXiv preprint, arXiv:2503.08002, 2025. doi:10.48550/arXiv.2503.08002
  8. [8]
    G. Stiglic, et al., "Interpretability of Machine Learning-Based Prediction Models in Healthcare," WIREs Data Mining and Knowledge Discovery, vol. 10, no. 5, e1379, 2020. ISSN: 1942-4795. doi:10.1002/widm.1379
  9. [9]
    I. D. Mienye dan Y. Sun, "A Survey of Ensemble Learning: Concepts, Algorithms, Applications, dan Prospects," IEEE Access, vol. 10, pp. 99129–99149, 2022. ISSN: 2169-3536. doi:10.1109/ACCESS.2022.3207287
  10. [10]
    M. Ali, et al., "A Survey on Ensemble Learning Techniques," ACM Computing Surveys, vol. 54, no. 2, pp. 1–36, 2021. ISSN: 0360-0300. doi:10.1145/3439726
  11. [11]
    Fadila Khairani, dkk., "Stacking Ensemble Learning Mengintegrasikan LR, SVM, dan RF untuk Prediksi Depresi pada Mahasiswa," Journal of Science and Social Research, vol. VII, no. 3, pp. 4256–4266, 2024. ISSN: 2615-4307 (Print) / 2615-3262 (Online).
  12. [12]
    J. Chung dan J. Teo, "Single Classifier vs. Ensemble Machine Learning Approaches for Mental Health Prediction," Brain Informatics, vol. 10, no. 1, pp. 1–10, 2023. ISSN: 2198-4018. doi:10.1186/s40708-022-00180-6
  13. [13]
    D. Imans, T. Abuhmed, M. Alharbi, dan S. El-Sappagh, "Explainable Multi-Layer Dynamic Ensemble Framework Optimized for Depression Detection and Severity Assessment," Diagnostics, vol. 14, no. 21, p. 2385, 2024. ISSN: 2075-4418. doi:10.3390/diagnostics14212385
  14. [14]
    M. Habib, et al., "Ensemble Machine Learning Approaches for Prediction of Patient Outcomes in Healthcare: A Comprehensive Review," Artificial Intelligence in Medicine, vol. 145, p. 102690, 2023. ISSN: 0933-3657. doi:10.1016/j.artmed.2023.102690
  15. [15]
    S. Uddin, et al., "Comparative Performance Analysis of K-Nearest Neighbour (KNN) Algorithm and its Different Variants for Disease Prediction," Scientific Reports, vol. 12, p. 6256, 2022. ISSN: 2045-2322. doi:10.1038/s41598-022-10358-x
  16. [16]
    B. Mahesh, "Machine Learning Algorithms — A Review," International Journal of Science and Research, vol. 9, no. 1, pp. 381–386, 2022. ISSN: 2319-7064. doi:10.21275/ART20203995
  17. [17]
    K. M. Ting dan I. H. Witten, "Issues in Stacked Generalization," Journal of Artificial Intelligence Research, vol. 10, pp. 271–289, 1999. ISSN: 1076-9757. doi:10.1613/jair.594
  18. [18]
    N. V. Chawla, K. W. Bowyer, L. O. Hall, dan W. P. Kegelmeyer, "SMOTE: Synthetic Minority Over-sampling Technique," Journal of Artificial Intelligence Research, vol. 16, pp. 321–357, 2002. ISSN: 1076-9757. doi:10.1613/jair.953
  19. [19]
    A. Alotaibi, "Ensemble Deep Learning Approaches in Health Care: A Review," Computers, Materials and Continua, vol. 82, no. 3, pp. 3741–3771, 2025. ISSN: 1546-2226. doi:10.32604/cmc.2025.061998
  20. [20]
    A. Aman dan R. S. Chhillar, "A Stacking-based Hybrid Model with Random Forest as Meta-learner for Diabetes Mellitus Prediction," International Journal of Machine Learning, vol. 14, no. 2, pp. 54–58, 2024. ISSN: 2180-1339.
  21. [21]
    A. Alanazi, "Stack Ensemble Model for ICU Length of Stay Prediction," Engineering, Technology and Applied Science Research, vol. 15, no. 1, pp. 19878–19883, 2025. ISSN: 2241-4487. doi:10.48084/etasr.9462 [22] F. Rustam, et al., "Classification of Heart Disease Using Stacking Ensemble Learning Framework," Journal of Personalized Medicine, vol. 15, no. 3, p. 215, 2025. ISSN: 2075-4426. doi:10.3390/jpm15030215
  22. [22]
    M. A. Al-Garadi, et al., "A Survey of Machine Learning-Based Approaches for Predicting Hospital Readmissions," International Journal of Medical Informatics, vol. 171, p. 104988, 2023. ISSN: 1386-5056. doi:10.1016/j.ijmedinf.2023.104988
  23. [23]
    S. Islam, et al., "Stacked Deep Ensemble Learning for Cancer Type Classification Using Multi-Omics Data Integration," JMIR Bioinformatics and Biotechnology, vol. 6, p. e63526, 2025. ISSN: 2691-8439. doi:10.2196/63526
  24. [24]
    O. M. Alade, et al., "Healthcare Risk Prediction Using Stacked Ensemble Learning," International Journal of Science and Research Archive, vol. 11, no. 1, pp. 2612–2624, 2024. ISSN: 2582-8185. doi:10.30574/ijsra.2024.11.1.0204
  25. [25]
    Y. Liu, et al., "Predicting Hospital Readmission Using Machine Learning Methods: A Systematic Review," JAMIA Open, vol. 6, no. 3, p. ooad062, 2023. ISSN: 2574-2531. doi:10.1093/jamiaopen/ooad062
  26. [26]
    W. Cao, et al., "The Psychological Impact of the COVID-19 Epidemic on College Students in China," Psychiatry Research, vol. 287, p. 112934, 2020. ISSN: 0165-1781. doi:10.1016/j.psychres.2020.112934
  27. [27]
    M. Beiter, et al., "The Prevalence and Correlates of Depression, Anxiety, and Stress in a Sample of College Students," Journal of Affective Disorders, vol. 173, pp. 90–96, 2015. ISSN: 0165-0327. doi:10.1016/j.jad.2014.10.054
  28. [28]
    C. S. Conley, J. A. Durlak, dan D. A. Dickson, "An Evaluative Review of Outcome Research on Universal Mental Health Promotion Programs," Journal of American College Health, vol. 61, no. 5, pp. 286–301, 2013. ISSN: 0744-8481. doi:10.1080/07448481.2013.802237
  29. [29]
    A. Reupert, et al., "Student Mental Health and Well-being: Research Findings and Recommendations," International Journal of Mental Health Promotion, vol. 23, no. 4, pp. 541–560, 2021. ISSN: 1462-3730. doi:10.32604/ijmhp.2021.018035

Article Metrics

23
views
27
downloads
Dimensions Citation Badge

Issue

JOCSTEC - September

Vol. 4 No. 3 (2026)
Section: Machine Learning
Categories: Machine Learning
pp. 248-256

How to Cite

[1]
Nasrun Marpaung, Dewi Maharani, and Akmal Nasution, “Application of Stacking Ensemble Learning for Classifying Patient Revisit Patterns in Primary Healthcare Facilities”, Journal Of Computer Science And Technology, vol. 4, no. 3, pp. 248–256, Sep. 2026, doi: 10.59435/jocstec.v4i3.947.

License

Share This Article