Meningkatkan kinerja SVM: Dampak berbagai teknik seleksi fitur pada akurasi prediksi

Lenny Margaretta Huizen; Muhammad Basyier Ardima; Mochamad Idris

doi:10.24246/aiti.v22i1.1-14

Authors

Lenny Margaretta Huizen Universitas Semarang
Muhammad Basyier Ardima Universitas Semarang
Mochamad Idris Universitas Semarang

DOI:

https://doi.org/10.24246/aiti.v22i1.1-14

Keywords:

feature selection, SVM, accuracy, data mining

Abstract

In Higher Education accreditation, student graduation plays an important role as one of the assessment criteria. Graduation prediction is the main focus of helping institutions assess a student to graduate on time. This study takes historical data from students who have graduated, which is taken through a questionnaire from the Department of Information Systems and Informatics Engineering at Semarang University students. The feature selection selects the most relevant attributes in graduation prediction. The results of this selection are tested using the Support Vector Machine (SVM) Algorithm. The main objective of this study is to evaluate the impact of feature selection on graduation prediction. The results show that SVM with feature selection using weight by relief achieves an accuracy of 82%, a precision of 83.42%, and a recall of 80.83%. In contrast, SVM without weight by relief shows an accuracy of 69.23%, a precision of 70.83%, and a recall of 67.86%. The use of feature selection successfully reduces features from 27 to four of the most influential features..

Downloads

Download data is not yet available.

Metrics

Metrics Loading ...

References

M. Rashif et al., “Fungsi Penilaian Instrumen Akreditasi bagi Institusi Perguruan Tinggi Baru.” Al’Adl: Jurnal Hukum, vol. 13, no. 2, pp. 391-409, 2021. DOI: https://doi.org/10.31602/al-adl.v13i2.3127

L. Setiyani, M. Wahidin, D. Awaludin, and S. Purwani, “Analisis Prediksi Kelulusan Mahasiswa Tepat Waktu Menggunakan Metode Data Mining Naïve Bayes: Systematic Review,” Faktor Exacta, vol. 13, no. 1, p. 35, Jun. 2020, doi: 10.30998/faktorexacta.v13i1.5548. DOI: https://doi.org/10.30998/faktorexacta.v13i1.5548

I. Made, B. Adnyana, S. B. Jln, and R. Puputan, “Penerapan Feature Selection untuk Prediksi Lama Studi Mahasiswa” Jurnal Sistem dan Informatika, vol. 13, no. 2, pp. 72-76, 2019.

S. Keputusan Dirjen Penguatan Riset dan Pengembangan Ristek Dikti et al., “Terakreditasi SINTA Peringkat 2 Penggunaan Feature Selection di Algoritma Support Vector Machine untuk Sentimen Analisis Komisi Pemilihan Umum,” masa berlaku mulai, vol. 1, no. 3, pp. 364–370, 2017.

H. M. Lumbantobing and R. A. Marcellino, “Penerapan Metode Feature Selection pada Algoritma Naïve Bayes dalam Kasus Keyword Extraction.” CITEE 2020, 2020.

S. R. Azizah, R. Herteno, A. Farmadi, D. Kartini, and I. Budiman, “Kombinasi Seleksi Fitur Berbasis Filter dan Wrapper Menggunakan Naïve Bayers pada Klasifikasi Penyakit Jantung”, Jurnal Teknologi Informasi dan Ilmu Komputer, vol. 10, no. 6, pp. 1361-1368, 2023, doi: 10.25126/jtiik.2023107467. DOI: https://doi.org/10.25126/jtiik.1067467

G. V. Gopal and G. R. M. Babu, “An ensemble feature selection approach using hybrid kernel based SVM for network intrusion detection system,” Indonesian Journal of Electrical Engineering and Computer Science, vol. 23, no. 1, pp. 558–565, Jul. 2021, doi: 10.11591/ijeecs.v23.i1.pp558-565. DOI: https://doi.org/10.11591/ijeecs.v23.i1.pp558-565

F. Abdusyukur, “Penerapan Algoritma Support Vector Machine (SVM) untuk Klasifikasi Pencemaran Nama Baik di Media Sosial Twitter,” KOMPUTA : Jurnal Ilmiah Komputer dan Informatika, vol. 12, no. 1, 2023. DOI: https://doi.org/10.34010/komputa.v12i1.9418

S. Nurhasanah Nugraha, T. Rivanie, S. Rahayu, W. Gata, R. Pebrianto, and S. Nusa Mandiri, “Sentimen Analisis Penerapan Social Distancing Menggunakan Feature Selection Pada Algoritma Support Vector Machine,” Jurnal Teknik Komputer AMIK BSI, vol. VI, no. 2, 2020, doi: 10.31294/jtk.v4i2.

A. Hendrawan, L. M. Huizen, A. Praba, R. Pinem, and A. Wicaksana, “Implementasi Pemilihan Fitur Metode Wrapper dan Embedded dalam Prediksi Ketepatan Kelulusan Mahasiswa”. Seminar Nasional Penelitian dan Pengabdian Kepada Masyarakat (SNPPKM), 2021.

D. Setiawan, “Komparasi Teknik Feature Selection Dalam Klasifikasi Serangan IoT Menggunakan Algoritma Decision Tree,” Jurnal Media Informatika Budidarma, vol. 8, no. 1, pp. 83-93, 2024, doi: 10.30865/mib.v8i1.6987.

H. Alshamlan, S. Omar, R. Aljurayyad, and R. Alabduljabbar, “Identifying Effective Feature Selection Methods for Alzheimer’s Disease Biomarker Gene Detection Using Machine Learning,” Diagnostics, vol. 13, no. 10, May 2023, doi: 10.3390/diagnostics13101771. DOI: https://doi.org/10.3390/diagnostics13101771

D. Setiawan, “Komparasi Teknik Feature Selection Dalam Klasifikasi Serangan IoT Menggunakan Algoritma Decision Tree,” Jurnal Media Informatika Budidarma, vol. 8, no. 1, pp. 83-93, 2024, doi: 10.30865/mib.v8i1.6987. DOI: https://doi.org/10.30865/mib.v8i1.6987

R. Wibowo and H. Indriyawati, “Top-k-Feature Selection untuk Deteksi Penyakit Hepatitis Menggunakan Algortime Naïve Bayes 1 Fakultas Teknologi Informasi dan Komunikasi.” Jurnal Buana Informatika, vol. 11, no. 1, pp. 1-9, 2020. DOI: https://doi.org/10.24002/jbi.v11i1.2456

I. Maulida, A. Suyatno, and H. R. Hatta, “Seleksi Fitur Pada Dokumen Abstrak Teks Bahasa Indonesia Menggunakan Metode Information Gain,” Jurnal SIFO Mikroskil, vol. 17, no. 2, pp. 249–258, Oct. 2016, doi: 10.55601/jsm.v17i2.379. DOI: https://doi.org/10.55601/jsm.v17i2.379

Y. Reswan, “DESAIN APLIKASI PENGENALAN POLA TANDA TANGAN MENGGUNAKAN METODE SUPPORT VECTOR MACHINE (SVM),” Jurnal Media Infotama, vol. 17, no. 1, pp. 8-12, 2021. DOI: https://doi.org/10.37676/jmi.v17i1.1311

A. Tzotsos and D. Argialas, “Support vector machine classification for object-based image analysis,” Lecture Notes in Geoinformation and Cartography, vol. 0, no. 9783540770572, pp. 663–677, 2008, doi: 10.1007/978-3-540-77058-9_36. DOI: https://doi.org/10.1007/978-3-540-77058-9_36

A. Budianita and F. I. Pratama, “Penerapan Algoritma Klasifikasi Dengan Fitur Seleksi Weight By Information Gain Pada Pemodelan Prediksi Kelulusan Mahasiswa,” Infotekmesin, vol. 11, no. 2, pp. 80–86, Aug. 2020, doi: 10.35970/infotekmesin.v11i2.255. DOI: https://doi.org/10.35970/infotekmesin.v11i2.255

J. Zhou, J. Huang, and L. Zheng, “Application of an Improved FSVM Algorithm in Breast Cancer Diagnosis,” Journal of Applied Mathematics and Computation, vol. 4, no. 2, pp. 18–25, May 2020, doi: 10.26855/jamc.2020.06.002. DOI: https://doi.org/10.26855/jamc.2020.06.002

I. Santoso, Windu Gata, and Atik Budi Paryanti, “Penggunaan Feature Selection di Algoritma Support Vector Machine untuk Sentimen Analisis Komisi Pemilihan Umum,” Jurnal RESTI (Rekayasa Sistem dan Teknologi Informasi), vol. 3, no. 3, pp. 364–370, Dec. 2019, doi: 10.29207/resti.v3i3.1084. DOI: https://doi.org/10.29207/resti.v3i3.1084