Peningkatan Akurasi Klasifikasi Sentimen Pengguna Dompet Digital Menggunakan Stacking Ensemble Machine Learning
DOI:
https://doi.org/10.59435/jocstec.v4i2.759Keywords:
Dompet Digital, Stacking Ensemble, Machine LearningAbstract
Penggunaan dompet digital yang terus meningkat menghasilkan banyak ulasan pengguna yang dapat dimanfaatkan untuk mengevaluasi kualitas layanan. Penelitian ini bertujuan meningkatkan akurasi klasifikasi sentimen pengguna dompet digital menggunakan metode Stacking Ensemble Machine Learning yang mengombinasikan Support Vector Machine (SVM), Multinomial Naïve Bayes (MNB), dan AdaBoost dengan Logistic Regression sebagai meta-learner. Data ulasan diproses melalui tahapan text preprocessing meliputi case folding, cleaning, tokenizing, stopword removal, stemming, dan pembobotan fitur menggunakan TF-IDF. Penyeimbangan data dilakukan dengan SMOTE, sedangkan evaluasi model menggunakan 5-Fold Cross-Validation. Hasil penelitian menunjukkan bahwa model Stacking Ensemble memperoleh akurasi rata-rata 80,55%, lebih tinggi dibandingkan algoritma dasar. Evaluasi menggunakan Confusion Matrix, Classification Report, dan ROC Curve juga menunjukkan peningkatan nilai precision, recall, F1-score, dan kemampuan diskriminasi model. Hasil ini menunjukkan bahwa pendekatan Stacking Ensemble Machine Learning efektif untuk meningkatkan akurasi klasifikasi sentimen pengguna dompet digital serta mendukung evaluasi kualitas layanan berbasis opini pengguna.
The rapid growth of digital wallet usage has generated a large volume of user reviews that can be utilized to evaluate service quality. This study aims to improve the accuracy of digital wallet user sentiment classification using a Stacking Ensemble Machine Learning approach that combines Support Vector Machine (SVM), Multinomial Naïve Bayes (MNB), and AdaBoost with Logistic Regression as the meta-learner. User reviews were processed through text preprocessing stages, including case folding, text cleaning, tokenization, stopword removal, stemming, and TF-IDF feature weighting. Synthetic Minority Over-sampling Technique (SMOTE) was employed to address class imbalance, while model performance was evaluated using 5-Fold Cross-Validation. The experimental results show that the proposed Stacking Ensemble model achieved an average accuracy of 80.55%, outperforming the individual base learners. Furthermore, evaluations based on the Confusion Matrix, Classification Report, and Receiver Operating Characteristic (ROC) Curve demonstrated improvements in precision, recall, F1-score, and the model's discriminative capability. These findings indicate that the proposed Stacking Ensemble Machine Learning approach is effective in improving the accuracy of digital wallet user sentiment classification and can serve as a reliable tool for supporting service quality evaluation based on user opinions.
Downloads
References
[1] H. Ferdiansyah, “Pengembangan Pariwisata Halal di Indonesia Melalui Konsep Smart Tourism,” Journal of Sustainable Tourism Research, vol. 4, no. 1, pp. 30–34, 2020, doi: 10.24198/tornare.v2i1.25831.
[2] J. Ipmawati, S. Saifulloh, and K. Kusnawi, “Analisis Sentimen Tempat Wisata Berdasarkan Ulasan pada Google Maps Menggunakan Algoritma Support Vector Machine,” MALCOM: Indonesian Journal of Machine Learning and Computer Science, vol. 4, no. 1, pp. 247–256, Jan. 2024, doi: 10.57152/malcom.v4i1.1066.
[3] N. A. M. Roslan, N. M. Diah, Z. Ibrahim, Y. Munarko, and A. E. Minarno, “Automatic plant recognition using convolutional neural network on Malaysian medicinal herbs: the value of data augmentation,” International Journal of Advances in Intelligent Informatics, vol. 9, no. 1, pp. 136–147, Mar. 2023, doi: 10.26555/ijain.v9i1.1076.
[4] P. Lahagun, B. Devkota, S. Giri, and P. Budha, “Machine Learning-Based Social Media Review Analysis for Recommending Tourist Spots,” Journal of Engineering and Sciences, vol. 3, no. 1, pp. 45–52, Jun. 2024, doi: 10.3126/jes2.v3i1.66234.
[5] Q. Sui and S. K. Ghosh, “Active Learning for Stacking and AdaBoost-Related Models,” Stats (Basel)., vol. 7, no. 1, pp. 110–137, Mar. 2024, doi: 10.3390/stats7010008.
[6] H. Zhu and A. Zhu, “Application Research of the XGBoost-SVM Combination Model in Quantitative Investment Strategy,” in International Conference on Systems and Informatics, Kunming: Institute of Electrical and Electronics Engineers Inc., Jan. 2022, pp. 1–7. doi: 10.1109/ICSAI57119.2022.10005355.
[7] J. M. Ahn, J. Kim, and K. Kim, “Ensemble Machine Learning of Gradient Boosting (XGBoost, LightGBM, CatBoost) and Attention-Based CNN-LSTM for Harmful Algal Blooms Forecasting,” Toxins (Basel)., vol. 15, no. 10, pp. 1–15, Oct. 2023, doi: 10.3390/toxins15100608.
[8] Agusviyanda, Hamdani, M. K. Anam, Agustin, and M. I. Wibowo, “Stacking Ensemble Machine Learning Model for Early Detection of Chronic Kidney Disease in Indonesia,” Rabit : Jurnal Teknologi dan Sistem Informasi Univrab, vol. 10, no. 2, pp. 1244–1252, Jul. 2025, doi: 10.36341/rabit.v10i2.6501.
[9] M. M. R. Mubarak, Y. H. Chrisnanto, and P. N. Sabrina, “Implementation of Random Forest Using Smote and Smoteenn in Customer Churn Classification in E-Commerce,” Enrichment: Journal of Multidisciplinary Research and Development, vol. 1, no. 8, pp. 463–477, Nov. 2023, doi: 10.55324/enrichment.v1i8.69.
[10] H. Rhomadhona and J. Permadi, “Klasifikasi Berita Kriminal Menggunakan Naïve Bayes Classifier (NBC) dengan Pengujian K-Fold Cross Validation,” Jurnal Sains dan Informatika, vol. 5, no. 2, pp. 108–117, 2019, doi: 10.34128/jsi.v5i2.177.
[11] R. J. Dhanal and V. R. Ghorpade, “Aspect-based sentiment-analysis using topic modelling and machine-learning,” International Journal of Electrical and Computer Engineering, vol. 14, no. 6, pp. 6689–6698, Dec. 2024, doi: 10.11591/ijece.v14i6.pp6689-6698.
[12] E. Ikhwan Saputra, M. Khairul Anam, H. Yenni, Hamdani, and A. Zamsuri, “Optimalisasi Algoritma Support Vector Machine pada Aspect-Based Sentiment Analysis Menggunakan GridSearchCV,” Zonasi (Jurnal Sistem Informasi), vol. 7, no. 1, pp. 271–279, 2025, doi: 10.31849/zn.v7i1.17800.
[13] M. K. Anam, M. I. Mahendra, W. Agustin, Rahmaddeni, and Nurjayadi, “Framework for Analyzing Netizen Opinions on BPJS Using Sentiment Analysis and Social Network Analysis (SNA),” Intensif, vol. 6, no. 1, pp. 2549–6824, 2022, doi: 10.29407/intensif.v6i1.15870.
[14] B. N. Pikir, M. K. Anam, H. Asnal, Rahmaddeni, and T. A. Fitri, “Sentiment Analysis of Technology Utilization by Pekanbaru City Government Based on Community Interaction in Social Media,” JAIA – Journal Of Artificial Intelligence And Applications, vol. 2, no. 1, pp. 32–40, 2021.
[15] R. S. Putra, W. Agustin, M. K. Anam, L. Lusiana, and S. Yaakub, “The Application of Naïve Bayes Classifier Based Feature Selection on Analysis of Online Learning Sentiment in Online Media,” Jurnal Transformatika, vol. 20, no. 1, pp. 44–56, Jul. 2022, doi: 10.26623/transformatika.v20i1.5144.
[16] Junadhi, Agustin, M. Rifqi, and M. K. Anam, “Sentiment Analysis of Online Lectures using K-Nearest Neighbors based on Feature Selection,” Jurnal Nasional Pendidikan Teknik Informatika (JANAPATI), vol. 11, no. 3, pp. 216–225, Dec. 2022, doi: 10.23887/janapati.v11i3.51531.
[17] A. N. Ulfah, M. K. Anam, N. Y. S. Munti, S. Yaakub, and M. B. Firdaus, “Sentiment Analysis of the Convict Assimilation Program on Handling Covid-19,” JUITA: Jurnal Informatika, vol. 10, no. 2, pp. 209–216, 2022, doi: 10.30595/juita.v10i2.12308.
Downloads
Published
License
Copyright (c) 2026 Ilmawati (Co Author); Nadya Alinda Rahmi, Elvira Sawitri (Author)
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.
