Published: 28-09-2025

Comparative Analysis Of Ensemble Learning Algorithms For Student Mental Health Classification: Balancing Predictive Performance And Computational Efficiency

Lia Umbari Putri
AMIK Polibisnis
Indonesia
Author
Laina Tussifah Santoso
AMIK Polibisnis
Indonesia
Co Author
Laina
AMIK Polibisnis
Indonesia
Co Author

Abstract

Student mental health disorders have become an increasingly important issue due to their significant impact on academic performance and psychological well-being. Machine learning-based approaches offer a promising alternative for supporting early detection; however, only a limited number of studies have conducted comprehensive evaluations of various ensemble learning algorithms by simultaneously considering predictive performance, computational efficiency, and statistical significance. This study aims to compare ten classification algorithms, namely Random Forest, Extra Trees, Gradient Boosting, Hist Gradient Boosting, AdaBoost, XGBoost, LightGBM, CatBoost, Logistic Regression, and Stacking Ensemble, using 5-fold Stratified Cross-Validation. Model performance was evaluated using Accuracy, Precision, Recall, F1-Score, Receiver Operating Characteristic–Area Under the Curve (ROC-AUC), training time, inference time, confusion matrix, feature importance, as well as One-Way Analysis of Variance (ANOVA) and post-hoc Tukey’s Honestly Significant Difference (Tukey HSD) tests. The experimental results show that CatBoost achieved the highest classification performance, with an Accuracy of 84.86%, an F1-Score of 87.19%, a Recall of 88.03%, and an ROC-AUC of 0.9220. XGBoost delivered comparable predictive performance with a substantially shorter training time (3.92 seconds), while LightGBM was the most computationally efficient algorithm, requiring an average training time of only 0.85 seconds. In contrast, the Stacking Ensemble required the longest training time (215.41 seconds) without providing a statistically meaningful performance improvement over the boosting-based models. The ANOVA results revealed significant differences in ROC-AUC among the evaluated models (p < 0.001), whereas the Tukey HSD test indicated that most boosting algorithms did not differ significantly from one another. These findings provide practical guidance for selecting classification algorithms by balancing predictive performance and computational efficiency to support early mental health screening systems for university students.

Keywords

ensemble learning machine learning Stratified Cross-Validation klasifikasi kesehatan mental mahasiswa

Views & Downloads Statistics (Last 12 Months)

Monthly performance and trends of article views and downloads
views: 0

References

14 References
Bibliography and cited literature of the article
  1. [1]
    A. Baba and K. Bunji, “Prediction of mental health problems using annual student health survey: Machine learning approach,” JMIR Formative Research, vol. 7, e42420, 2023, doi:10.2196/42420.
  2. [2]
    V. Elysia, I. Rokhiyah, M. Y. Setiani, A. Priatna, and T. Chandrawati, “Examining mental health needs of open and distance learning students: A case study of Universitas Terbuka, Indonesia,” Jurnal Penelitian dan Evaluasi Pendidikan, vol. 18, no. 2, pp. 89–98, 2024, doi:10.21831/jpip.v18i2.94621.
  3. [3]
    M. J. Faisti, R. H. Kusumodestoni, and G. W. N. Wibowo, “Mental health classification using Naïve Bayes and Random Forest algorithms,” Journal of Applied Informatics and Computing, vol. 9, no. 4, pp. 315–322, 2025, doi:10.30871/jaic.v9i4.8448.
  4. [4]
    W. Febriani, M. Mambang, S. E. Prastya, B. Sabella, and F. D. Marleny, “Analysis of the impact of violent content on social media on adolescent cyberpsychology using Support Vector Machine and Random Forest,” Journal of Applied Informatics and Computing, vol. 10, no. 1, pp. 45–52, 2026, doi:10.30871/jaic.v10i1.8901.
  5. [5]
    T. Chen and C. Guestrin, “XGBoost: A scalable tree boosting system,” in Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, 2016, pp. 785–794, doi:10.1145/2939672.2939785.
  6. [6]
    G. Ke et al., “LightGBM: A highly efficient gradient boosting decision tree,” in Advances in Neural Information Processing Systems, vol. 30, 2017.
  7. [7]
    L. Prokhorenkova, G. Gusev, A. Vorobev, A. V. Dorogush, and A. Gulin, “CatBoost: Unbiased boosting with categorical features,” in Advances in Neural Information Processing Systems, vol. 31, 2018.
  8. [8]
    L. Zhang and D. Jánošík, “Enhanced short-term load forecasting with hybrid machine learning models: CatBoost and XGBoost approaches,” Expert Systems with Applications, vol. 241, 122686, 2024, doi:10.1016/j.eswa.2023.122686.
  9. [9]
    M. H. Izzaturrahim, I. B. P. Prayoga, A. N. Hilmy, N. P. Utama, and A. Purwarianti, “Implementation of Stacking Ensemble Learning method for fraud detection in financial transactions,” Jurnal Teknologi Informasi dan Ilmu Komputer, vol. 11, no. 3, pp. 521–530, 2024, doi:10.25126/jtiik.202411388601.
  10. [10]
    S. Zhao, D. Zhou, H. Wang, and L. Yu, “Ensemble-learning techniques for predicting student performance on video-based learning,” International Journal of Information and Education Technology, vol. 12, no. 8, pp. 741–745, 2022, doi:10.18178/ijiet.2022.12.8.1678.
  11. [11]
    S. Suryadi, “XGBoost algorithm for cervical cancer risk prediction: Multi-dimensional feature analysis,” Jurnal RESTI (Rekayasa Sistem dan Teknologi Informasi), vol. 9, no. 3, pp. 619–625, 2025, doi:10.29207/resti.v9i3.6587.
  12. [12]
    Trelles, A., Ruiz, T. F., & Rojo, A. P., Systematic Review and Meta-Analysis of Explainable Machine Learning Models for Clinical Depression Detection, Behavioral Sciences, vol. 15, no. 11, 2025. doi:10.3390/bs15111476.
  13. [13]
    Schaab, B. L., et al., How do machine learning models perform in the detection of depression, anxiety, and stress among undergraduate students? A systematic review, Cadernos de Saúde Pública, vol. 40, no. 11, 2024. doi:10.1590/0102-311XEN029323.
  14. [14]
    Cai, Y., Lin, D., & Lu, Q., Comparison of Different Machine Learning Algorithms in the Mental Health Assessment of College Students, Journal of ICT Standardization, 2024. doi:10.13052/jicts2245-800X.1243.

Article Metrics

0
views
0
downloads
Dimensions Citation Badge

Issue

JOCSTEC - September

Vol. 4 No. 3 (2026)
Section: Machine Learning
Categories: Machine Learning
pp. 268-283

How to Cite

[1]
Lia Umbari Putri, Laina Tussifah Santoso, and Masri Wahyuni, Trans., “Comparative Analysis Of Ensemble Learning Algorithms For Student Mental Health Classification: Balancing Predictive Performance And Computational Efficiency”, Journal Of Computer Science And Technology, vol. 4, no. 3, pp. 268–283, Sep. 2025, doi: 10.59435/jocstec.v4i3.764.

License

Share This Article