DOI: https://doi.org/10.14710/jtsiskom.8.2.2020.89-93

K-means-SMOTE untuk menangani ketidakseimbangan kelas dalam klasifikasi penyakit diabetes dengan C4.5, SVM, dan naive Bayes

K-means-SMOTE for handling class imbalance in the classification of diabetes with C4.5, SVM, and naive Bayes

1Universitas Bumigora, Indonesia

2Sekolah Tinggi Manajemen Informatika dan Komputer Lombok, Indonesia

Received: 6 Nov 2019; Revised: 10 Feb 2020; Accepted: 14 Feb 2020; Published: 30 Apr 2020; Available online: 15 Feb 2020.
Open Access Copyright (c) 2020 Jurnal Teknologi dan Sistem Komputer
Creative Commons License This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.

Citation Format:
Abstract
The occurrence of imbalanced class in a dataset causes the classification results to tend to the class with the largest amount of data (majority class). A sampling method is needed to balance the minority class (positive class) so that the class distribution becomes balanced and leading to better classification results. This study was conducted to overcome imbalanced class problems on the Indian Pima diabetes illness dataset using k-means-SMOTE. The dataset has 268 instances of the positive class (minority class) and 500 instances of the negative class (majority class). The classification was done by comparing C4.5, SVM, and naïve Bayes while implementing k-means-SMOTE in data sampling. Using k-means-SMOTE, the SVM classification method has the highest accuracy and sensitivity of 82 % and 77 % respectively, while the naive Bayes method produces the highest specificity of 89 %.

Note: This article has supplementary file(s).

Fulltext View|Download |  Data Set
Pima Indian Diabetes Dataset
Subject
Type Data Set
  Download (71KB)    Indexing metadata
Keywords: k-means-SMOTE; SMOTE; classification performance; class imbalance
Funding: Universitas Bumigora

Article Metrics:

Article Info
Section: Original Research Articles
Language : ID
Statistics:
Share:
Related articles
Maximum Likelihood Classification with Fast Fourier Transform Feature Extraction for Car Recognition Decision Support System for Football Players Lineup Selection using Fuzzy Multiple Attribute Decision Making and K-Means Clustering Methods Comparison analysis of Euclidean and Gower distance measures on k-medoids cluster Preprocessing kNN algorithm classification using K-means and distance matrix with students’ academic performance dataset MWMOTE optimization for imbalanced data using complete linkage More related articles
Most cited articles
Mobile Application of Expert System for Meningitis Early Diagnosis Discrimination of civet coffee using visible spectroscopy Implementasi Algoritma Kriptografi RSA untuk Enkripsi dan Dekripsi Email Pembuatan Aplikasi “Warung Keluarga” Sebagai Aplikasi E-Commerce Berbasis Web dan Mobile Pengembangan Sistem Pakar Untuk Diagnosis Penyakit Hepatitis Berbasis Web Menggunakan Metode Certainty Factor More cited articles
  1. B. Santoso, H. Wijayanto, K. Notodiputro, and B. Sartono, “Class imbalanced problems: a review,” Conference Series: Earth and Environmental Science., vol. 58, no. 1, pp. 427-436, 2017. doi: 10.1088/1755-1315/58/1/012031
  2. N. V Chawla, K. W. Bowyer, and L. O. Hall, “SMOTE : synthetic minority over-sampling technique,” Journal of Artificial Intelligence Research, vol. 16, pp. 341-378, 2002. doi: 10.1613/jair.953
  3. S. Sisodia, N. K. Reddy, and S. Bhandari, “Performance evaluation of class balancing techniques for credit card fraud detection,” in IEEE International Conference on Power, Control, Signals and Instrumentation Engineering, Chennai, India, Sept. 2017, pp. 2747–2752. doi: 10.1109/ICPCSI.2017.8392219
  4. L. Demidova and I. Klyueva, “SVM classification: optimization with the SMOTE algorithm for the class imbalance problem,” in 6th Mediterranean Conference on Embedded Computing (MECO), Bar, Montenegro, Jun. 2017, pp. 17–20. doi: 10.1109/MECO.2017.7977136
  5. F. A. Bachtiar, I. K. Syahputra, and S. A. Wicaksono, “Perbandingan algoritme machine learning untuk memprediksi pengambil matakuliah,” Jurnal Teknologi Informasi dan Ilmu Komputer, vol. 6, no. 5, pp. 543-548, 2019. doi: 10.25126/jtiik.2019651755
  6. L. Demidova and I. Klyueva, “Improving the classification quality of the SVM classifier for the imbalanced datasets on the base of ideas the SMOTE algorithm,” ITM Web of Conferences, vol. 10, 2017, pp. 1-4. doi: 10.1051/itmconf/20171002002
  7. Y. Pristyanto, N. A. Setiawan, and I. Ardiyanto, “Hybrid resampling to handle imbalanced class on classification of student performance in classroom,” in 1st International Conference on Informatics and Computational Sciences (ICICoS), Semarang, Indonesia, Nov. 2017, pp. 207-212. doi: 10.1109/ICICOS.2017.8276363
  8. H. Hairani, N. A. Setiawan, and T. B. Adji, “Metode klasifikasi data mining dan teknik sampling SMOTE menangani class imbalance untuk segmentasi customer pada industri perbankan,” in Seminar Nasional Sains dan Teknologi, Semarang, Indonesia, Aug. 2016, pp. 168-172
  9. A. C. Flores, R. I. Icoy, C. F. Pena, and K. D. Gorro, “An evaluation of SVM and naive Bayes with SMOTE on sentiment analysis data set,” in 2018 International Conference on Engineering, Applied Sciences, and Technology (ICEAST), Phuket, Thailand, Jul. 2018, pp. 1-4. doi: 10.1109/ICEAST.2018.8434401
  10. Z. Ulhaq and T. B. Adji, “Integrasi synthetic minority over-sampling technique (SMOTE) dengan correlated naïve Bayes pada klasifikasi siswa berkesulitan belajar,” in CITEE, Yogyakarta, Indonesia, Jul. 2017, pp. 201-205
  11. R. Siringoringo, “Klasifikasi data tidak seimbang menggunakan algoritma SMOTE dan k-nearest neighbor,” Journal Information System Development, vol. 3, no. 1, pp. 44-49, 2018
  12. G. Douzas, F. Bacao, and F. Last, “Improving imbalanced learning through a heuristic oversampling method based on k-means and SMOTE,” Information System, vol. 465, pp. 1-20, 2018. doi: 10.1016/j.ins.2018.06.056
  13. H. Hairani, G. Nugraha, M. Nurkholis Abdillah, and M. Innuddin, “Komparasi akurasi metode correlated naive Bayes classifier dan naive Bayes classifier untuk diagnosis penyakit diabetes,” InfoTekJar (Jurnal Nasional. Informatika dan Teknologi Jaringan), vol. 3, no. 1, pp. 6-11, 2018
  14. L. Nass, S. Swift, and A. Al Dallal, “Indepth analysis of medical dataset mining: a comparitive analysis on a diabetes dataset before and after preprocessing,” KnE Social Sciences, vol. 3, no. 25, pp. 45-63, 2019. doi: 10.18502/kss.v3i25.5190
  15. X. Wu et al., “Top 10 algorithms in data mining,” Knowledge and information systems, vol. 14, no. 1, pp. 1-37, 2008
  16. N. Nurajijah and D. Riana, “Algoritma naïve Bayes, decision tree, dan SVM untuk klasifikasi persetujuan pembiayaan nasabah koperasi syariah,” Jurrnal Teknologi dan Sistem Komputer., vol. 7, no. 2, pp. 77-82, 2019. doi: 10.14710/jtsiskom.7.2.2019.77-82

Last update:

  1. A proposed method for handling an imbalance data in classification of blood type based on Myers-Briggs type indicator

    Ahmad Taufiq Akbar, Rochmat Husaini, Bagus Muhammad Akbar, Shoffan Saifullah. Jurnal Teknologi dan Sistem Komputer, 8 (4), 2020. doi: 10.14710/jtsiskom.2020.13625

  2. Discrimination of civet coffee using visible spectroscopy

    Graciella Mae L Adier, Charlene A Reyes, Edwin R Arboleda. Jurnal Teknologi dan Sistem Komputer, 8 (3), 2020. doi: 10.14710/jtsiskom.2020.13734

  3. Integrasi Metode Naive Bayes dengan K-Means dan K-Means-Smote untuk Klasifikasi Jurusan SMAN 3 Mataram

    Hairani Hairani, Muhammad Ridho Hansyah, Lalu Zazuli Azhar Mardedi. Jurnal Sistem dan Informatika (JSI), 15 (1), 2020. doi: 10.30864/jsi.v15i1.317

  4. A Comparative Performance Analysis of Data Resampling Methods on Imbalance Medical Data

    Matloob Khushi, Kamran Shaukat, Talha Mahboob Alam, Ibrahim A. Hameed, Shahadat Uddin, Suhuai Luo, Xiaoyan Yang, Maranatha Consuelo Reyes. IEEE Access, 9 , 2021. doi: 10.1109/ACCESS.2021.3102399

  5. MWMOTE optimization for imbalanced data using complete linkage

    Meida Cahyo Untoro. Jurnal Teknologi dan Sistem Komputer, 9 (2), 2021. doi: 10.14710/jtsiskom.2021.13748

  6. Accuracy Enhancement of Correlated Naive Bayes Method by Using Correlation Feature Selection (CFS) for Health Data Classification

    Hairani Hairani, Muhammad Innuddin, Majid Rahardi. 2020 3rd International Conference on Information and Communications Technology (ICOIACT), 2020. doi: 10.1109/ICOIACT50329.2020.9332021

Last update: 2021-09-21 00:31:11

  1. Accuracy Enhancement of Correlated Naive Bayes Method by Using Correlation Feature Selection (CFS) for Health Data Classification

    Hairani Hairani, Muhammad Innuddin, Majid Rahardi. 2020 3rd International Conference on Information and Communications Technology (ICOIACT), 2020. doi: 10.1109/ICOIACT50329.2020.9332021