Improving Random Forest Evaluation in Mental Health Disorder Identification with Cross Validation

Rosyida Choirunnisa; Mochammad Anshori; Wahyu Teja Kusuma

doi:10.31004/riggs.v4i2.1053

Authors

Rosyida Choirunnisa Institut Teknologi Sains dan Kesehatan RS DR Soepraoen Kesdam V/ BRW
Mochammad Anshori Institut Teknologi Sains dan Kesehatan RS DR Soepraoen Kesdam V/ BRW
Wahyu Teja Kusuma Institut Teknologi Sains dan Kesehatan RS DR Soepraoen Kesdam V/ BRW

DOI:

https://doi.org/10.31004/riggs.v4i2.1053

Keywords:

Random Forest, Cross Validation, Identification, Mental Health Disorders

Abstract

Mental health disorders are often difficult to detect and diagnose, causing misdiagnoses which lead to inappropriate treatment and have a negative impact on the sufferer's quality of life. This research aims to develop an accurate and efficient model for identifying mental health disorders by utilizing the Random Forest method and Cross Validation techniques. Random Forest was chosen because of its ability to improve prediction accuracy and training speed. Cross Validation is used to train and test models with various combinations of data, and reduces the risk of Overfitting. The dataset consists of 120 data with 18 behavioral attributes and diagnoses, with four target classes: Bipolar Type-1, Bipolar Type-2, Depression, and Normal. Four Cross Validation experimental scenarios were tested: k=5 and k=10, and k=5 and k=10 with Stratified to reduce data bias. Experimental results show that k=10 stratified cross-validation produces the highest accuracy (87.5%), with precision, recall, and F1-score also reaching 87.5%. The Stratified technique is proven to improve the balance of class distribution and reduce the risk of Overfitting. These findings confirm that Random Forest with k=10 Stratified Cross-Validation is the optimal approach for diagnosing mental health disorders. The implications of this research include the potential for applying models in AI-based systems to assist medical personnel in more accurate and efficient early diagnosis.

Downloads

Download data is not yet available.

References

F. Siska and S. Heni, “Analisis Data Hasil Diagnosa Untuk Klasifikasi Gangguan Kepribadian Menggunakan Algoritma C4.5,” J. Teknol. dan Sist. Inf., vol. 2, no. 4, pp. 89–95, 2021, doi: 10.33365/jtsi.v2i4.1373.

A. W. Widiarni, S. Sarah, R. A. A. Astri, and M. Mustakim, “Diagnosis Penyakit Mental Pada Remaja Menggunakan Metode Simple Multi Attribute Rating Technique Exploiting Rank (SMARTER),” Indones. J. Inform. Res. Softw. Eng., vol. 2, no. 2, pp. 100–108, 2022, doi: 10.57152/ijirse.v2i2.444.

M. I. Maulana, Z. Lessy, U. Islam, N. Sunan, U. Islam, and N. Sunan, “Upaya Penanganan Dan Peningkatan Kesehatan Mental,” Koloni, vol. 2, no. 4, pp. 90–98, 2023, doi: 10.31004/koloni.v2i4.549.

F. I. Kesehatan, U. Kusuma, H. Surakarta, and S. Mahmudah, “Asuhan keperawatan jiwa pada pasien dengan gangguan halusinasi,” 2020.

S. Y. Prasetyo and G. Z. Nabiilah, “Perbandingan Model Machine Learning pada Klasifikasi Tumor Otak Menggunakan Fitur Discrete Cosine Transform,” J. Teknol. Terpadu, vol. 9, no. 1, pp. 29–34, 2023, doi: 10.54914/jtt.v9i1.605.

M. Astriliana and E. R. Kustanti, “Pengalaman Sebagai Pasien Dengan Gangguan Bipolar Tipe I (Sebuah Interpretative Phenomenological Analysis),” J. EMPATI, vol. 13, no. 1, pp. 78–89, 2023, doi: 10.14710/empati.2024.27722.

U. Fisabilih, “Analisis Gejala Gangguan Afektif Bipolar Tipe II Berdasarkan DSM V,” J. Ris. Kesehat. Mod., vol. 6, no. 3, pp. 205–212, 2024.

A. A. C. A. Sukmana, P. D. A. Putra, and R. D. S. Dinata, “Perancangan Komik Strip Sebagai Sarana Kampanye Dampak Orang Tua Abusive Terhadap Perkembangan Kesehatan Mental Remaja Di Denpasar,” J. Selaras Rupa, vol. 2, no. 1, pp. 60–68, 2021, [Online]. Available: https://jurnal.idbbali.ac.id/index.php/selarasrupa

N. R. Muntiari and K. H. Hanif, “Klasifikasi Penyakit Kanker Payudara Menggunakan Perbandingan Algoritma Machine Learning,” J. Ilmu Komput. dan Teknol., vol. 3, no. 1, pp. 1–6, May 2022, doi: 10.35960/ikomti.v3i1.766.

I. M. Faiza, G. Gunawan, and W. Andriani, “Tinjauan Pustaka Sistematis: Penerapan Metode Machine Learning untuk Deteksi Bencana Banjir,” J. Minfo Polgan, vol. 11, no. 2, pp. 59–63, 2022, doi: 10.33395/jmp.v11i2.11657.

I. Sari, Fivrenodi, E. Altiarika, and Sarwindah, “Sistem Pengembangan Bahasa Isyarat Untuk Berkomunikasi dengan Penyandang Disabilitas (Tunarungu),” J. Inf. Technol. Soc., vol. 1, no. 1, pp. 20–25, 2023, doi: 10.35438/jits.v1i1.21.

S. P. R. Yulianto, A. Z. Fanani, A. Affandy, and M. I. Aziz, “Analisis Metode Smoote pada Klasifikasi Penyakit Jantung Berbasis Random Forest Tree,” J. Media Inform. Budidarma, vol. 8, no. 3, p. 1460, 2024, doi: 10.30865/mib.v8i3.7712.

D. Benaya, “Implementasi Random Forest dalam Klasifikasi Kanker Paru-Paru,” JOINTER J. Informatics Eng., vol. 5, no. 01, pp. 27–31, 2024, doi: 10.53682/jointer.v5i01.331.

Gde Agung Brahmana Suryanegara, Adiwijaya, and Mahendra Dwifebri Purbolaksono, “Peningkatan Hasil Klasifikasi pada Algoritma Random Forest untuk Deteksi Pasien Penderita Diabetes Menggunakan Metode Normalisasi,” J. RESTI (Rekayasa Sist. dan Teknol. Informasi), vol. 5, no. 1, pp. 114–122, Feb. 2021, doi: 10.29207/resti.v5i1.2880.

R. Darmawan, Y. H. Chrisnanto, and G. Abdillah, “KLASIFIKASI DIAGNOSA PENYAKIT TIROID MENGGUNAKAN METODE,” vol. 7, no. 2, pp. 203–209, 2024, doi: 10.36595/jire.v7i2.1214.

S. P. Tamba and E. -, “Prediksi Penyakit Gagal Jantung Dengan Menggunakan Random Forest,” J. Sist. Inf. dan Ilmu Komput. Prima(JUSIKOM PRIMA), vol. 5, no. 2, pp. 176–181, 2022, doi: 10.34012/jurnalsisteminformasidanilmukomputer.v5i2.2445.

F. Hamami and I. A. Dahlan, “Klasifikasi Cuaca Provinsi Dki Jakarta Menggunakan Algoritma Random Forest Dengan Teknik Oversampling,” J. Teknoinfo, vol. 16, no. 1, p. 87, 2022, doi: 10.33365/jti.v16i1.1533.

W. A. Firmansyach, U. Hayati, and Y. Arie Wijaya, “Analisa Terjadinya Overfitting Dan Underfitting Pada Algoritma Naive Bayes Dan Decision Tree Dengan Teknik Cross Validation,” JATI (Jurnal Mhs. Tek. Inform., vol. 7, no. 1, pp. 262–269, 2023, doi: 10.36040/jati.v7i1.6329.

M. Anshori, N. Rikatsih, and M. S. Haris, “Prediksi Pasien Dengan Penyakit Kardiovaskular Menggunakan Random Forest,” TEKTRIKA - J. Penelit. dan Pengemb. Telekomun. Kendali, Komputer, Elektr. dan Elektron., vol. 7, no. 2, p. 58, 2023, doi: 10.25124/tektrika.v7i2.5279.

W. Wijiyanto, A. I. Pradana, S. Sopingi, and V. Atina, “Teknik K-Fold Cross Validation untuk Mengevaluasi Kinerja Mahasiswa,” J. Algoritm., vol. 21, no. 1, pp. 239–248, 2024, doi: 10.33364/algoritma/v.21-1.1618.

V. Karbalaeipour, Hengameh; Damari, Siavash; Zolfagharnasab, Mohammad Hossein; Haghdadi, Amin, DVN/0FNET5 , Harvard Dataverse, “Dataset-Mental-Disorders,” 2023. doi: doi.org/10.7910.

H. Azis, P. Purnawansyah, F. Fattah, and I. P. Putri, “Performa Klasifikasi K-NN dan Cross Validation Pada Data Pasien Pengidap Penyakit Jantung,” Ilk. J. Ilm., vol. 12, no. 2, pp. 81–86, 2020, doi: 10.33096/ilkom.v12i2.507.81-86.

A. Farmadi and M. Muliadi, “Deteksi Penyakit Tanaman Padi Menggunakan Ekstraksi Firur Lbp Dan Klasifikasi Modified Knn,” J. Komputasi, vol. 11, no. 2, pp. 129–137, 2023, doi: 10.23960/komputasi.v11i2.13238.

M. B. Hanif, H. A. D. Rani, A. Pratama, and R. I. Sudomo, “Klasifikasi Persalinan Prematur Menggunakan Perbandingan Algoritma C4.5 dan Random Forest,” Joined J. (Journal Informatics Educ., vol. 5, no. 2, pp. 61–72, Dec. 2022, doi: 10.31331/joined.v5i2.2503.

M. M. Mutoffar and A. Fadillah, “Klasifikasi Kualitas Air Sumur Menggunakan Algoritma Random Forest,” Naratif J. Nas. Riset, Apl. dan Tek. Inform., vol. 4, no. 2, pp. 138–146, 2022, doi: 10.53580/naratif.v4i2.160.

N. Ambika Hapsari and A. Dwi Indriyanti, “Analisis Sentimen pada Aplikasi Dompet Digital Menggunakan Algoritma Random Forest,” J. Emerg. Inf. Syst. Bus. Intell., vol. 04, no. 03, pp. 186–192, 2023.

R. R. R. Arisandi, B. Warsito, and A. R. Hakim, “Aplikasi Naïve Bayes Classifier (Nbc) Pada Klasifikasi Status Gizi Balita Stunting Dengan Pengujian K-Fold Cross Validation,” J. Gaussian, vol. 11, no. 1, pp. 130–139, 2022, doi: 10.14710/j.gauss.v11i1.33991.

W. Andriyani et al., Matematika pada Kecerdasaan Buatan. Makassar: CV. Tohar Media, 2024.