Comparative Analysis Of Ensemble Learning Algorithms For Student Mental Health Classification: Balancing Predictive Performance And Computational Efficiency
Abstract
Student mental health disorders have become an increasingly important issue due to their significant impact on academic performance and psychological well-being. Machine learning-based approaches offer a promising alternative for supporting early detection; however, only a limited number of studies have conducted comprehensive evaluations of various ensemble learning algorithms by simultaneously considering predictive performance, computational efficiency, and statistical significance. This study aims to compare ten classification algorithms, namely Random Forest, Extra Trees, Gradient Boosting, Hist Gradient Boosting, AdaBoost, XGBoost, LightGBM, CatBoost, Logistic Regression, and Stacking Ensemble, using 5-fold Stratified Cross-Validation. Model performance was evaluated using Accuracy, Precision, Recall, F1-Score, Receiver Operating Characteristic–Area Under the Curve (ROC-AUC), training time, inference time, confusion matrix, feature importance, as well as One-Way Analysis of Variance (ANOVA) and post-hoc Tukey’s Honestly Significant Difference (Tukey HSD) tests. The experimental results show that CatBoost achieved the highest classification performance, with an Accuracy of 84.86%, an F1-Score of 87.19%, a Recall of 88.03%, and an ROC-AUC of 0.9220. XGBoost delivered comparable predictive performance with a substantially shorter training time (3.92 seconds), while LightGBM was the most computationally efficient algorithm, requiring an average training time of only 0.85 seconds. In contrast, the Stacking Ensemble required the longest training time (215.41 seconds) without providing a statistically meaningful performance improvement over the boosting-based models. The ANOVA results revealed significant differences in ROC-AUC among the evaluated models (p < 0.001), whereas the Tukey HSD test indicated that most boosting algorithms did not differ significantly from one another. These findings provide practical guidance for selecting classification algorithms by balancing predictive performance and computational efficiency to support early mental health screening systems for university students.
Keywords
Views & Downloads Statistics (Last 12 Months)
References
14 References-
[1]A. Baba and K. Bunji, “Prediction of mental health problems using annual student health survey: Machine learning approach,” JMIR Formative Research, vol. 7, e42420, 2023, doi:10.2196/42420.
-
[2]V. Elysia, I. Rokhiyah, M. Y. Setiani, A. Priatna, and T. Chandrawati, “Examining mental health needs of open and distance learning students: A case study of Universitas Terbuka, Indonesia,” Jurnal Penelitian dan Evaluasi Pendidikan, vol. 18, no. 2, pp. 89–98, 2024, doi:10.21831/jpip.v18i2.94621.
-
[3]M. J. Faisti, R. H. Kusumodestoni, and G. W. N. Wibowo, “Mental health classification using Naïve Bayes and Random Forest algorithms,” Journal of Applied Informatics and Computing, vol. 9, no. 4, pp. 315–322, 2025, doi:10.30871/jaic.v9i4.8448.
-
[4]W. Febriani, M. Mambang, S. E. Prastya, B. Sabella, and F. D. Marleny, “Analysis of the impact of violent content on social media on adolescent cyberpsychology using Support Vector Machine and Random Forest,” Journal of Applied Informatics and Computing, vol. 10, no. 1, pp. 45–52, 2026, doi:10.30871/jaic.v10i1.8901.
-
[5]T. Chen and C. Guestrin, “XGBoost: A scalable tree boosting system,” in Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, 2016, pp. 785–794, doi:10.1145/2939672.2939785.
-
[6]G. Ke et al., “LightGBM: A highly efficient gradient boosting decision tree,” in Advances in Neural Information Processing Systems, vol. 30, 2017.
-
[7]L. Prokhorenkova, G. Gusev, A. Vorobev, A. V. Dorogush, and A. Gulin, “CatBoost: Unbiased boosting with categorical features,” in Advances in Neural Information Processing Systems, vol. 31, 2018.
-
[8]L. Zhang and D. Jánošík, “Enhanced short-term load forecasting with hybrid machine learning models: CatBoost and XGBoost approaches,” Expert Systems with Applications, vol. 241, 122686, 2024, doi:10.1016/j.eswa.2023.122686.
-
[9]M. H. Izzaturrahim, I. B. P. Prayoga, A. N. Hilmy, N. P. Utama, and A. Purwarianti, “Implementation of Stacking Ensemble Learning method for fraud detection in financial transactions,” Jurnal Teknologi Informasi dan Ilmu Komputer, vol. 11, no. 3, pp. 521–530, 2024, doi:10.25126/jtiik.202411388601.
-
[10]S. Zhao, D. Zhou, H. Wang, and L. Yu, “Ensemble-learning techniques for predicting student performance on video-based learning,” International Journal of Information and Education Technology, vol. 12, no. 8, pp. 741–745, 2022, doi:10.18178/ijiet.2022.12.8.1678.
-
[11]S. Suryadi, “XGBoost algorithm for cervical cancer risk prediction: Multi-dimensional feature analysis,” Jurnal RESTI (Rekayasa Sistem dan Teknologi Informasi), vol. 9, no. 3, pp. 619–625, 2025, doi:10.29207/resti.v9i3.6587.
-
[12]Trelles, A., Ruiz, T. F., & Rojo, A. P., Systematic Review and Meta-Analysis of Explainable Machine Learning Models for Clinical Depression Detection, Behavioral Sciences, vol. 15, no. 11, 2025. doi:10.3390/bs15111476.
-
[13]Schaab, B. L., et al., How do machine learning models perform in the detection of depression, anxiety, and stress among undergraduate students? A systematic review, Cadernos de Saúde Pública, vol. 40, no. 11, 2024. doi:10.1590/0102-311XEN029323.
-
[14]Cai, Y., Lin, D., & Lu, Q., Comparison of Different Machine Learning Algorithms in the Mental Health Assessment of College Students, Journal of ICT Standardization, 2024. doi:10.13052/jicts2245-800X.1243.
