CNN and SVM Combination for Multi-Class Classification of Diabetic Retinopathy Based on Fundus Imaging

Tinuk Agustin, Moch. Hari Purwidiantoro, Ema Utami, Hanif Al Fatta

Abstract


Diabetic Retinopathy (DR) is a cause of blindness. Early detection has the potential to save the patient's vision. Reading fundoscopic photos requires more expertise and effort by the ophthalmologist. There are many visual similarities in lesions and only minor differences in the spatial domain. A computer-assisted automatic detection system is needed to assist medical experts in DR diagnosis and can reduce costs. This study proposes a combination method of Convolutional Neural Network (CNN) and Support Vector Machine (SVM) for the automatic classification of Diabetic Retinopathy (DR). The pre-train architecture Inception-V3 uses for feature extraction of input data. After training and getting the best model, the next is classification with SVM. Data augmentation techniques use to multiply and add variations to the dataset. Before the feature extraction stage, the dataset will process by separating the green channel from the RGB image. Next, the CLAHE will require increasing the contrast of the picture. This study aims to improve the performance in multi-class DR classification. The proposed model uses four classes of unbalanced and small datasets from retinal fundus images. This paper also compares the combined performance of CNN SVM with CNN Softmax based on the accuracy value to validate the results. Our experiments show that the combination of CNN SVM can increase the accuracy of auto-detection of DR severity up to 11.48% better than CNN softmax. The results showed that the pre-trained architectural model from the combination of Inception-V3 with SVM classification improves the accuracy extensively, even on small and unbalanced datasets.

Keywords


Convolutional Neural Network; Support Vector Machine; Diabetic Retinopathy; Transfer learning; Multi-class classification

Full Text:

Link Download

References


Agustin, T., & Sunyoto, A. (2020). Optimization Convolutional Neural Network for Classification Diabetic Retinopathy Severity. 2020 3rd International Conference on Information and Communications Technology (ICOIACT), 66–71. https://doi.org/10.1109/ICOIACT50329.2020.9332087

Agustin, T., Utami, E., & Fatta, H. Al. (2020). Implementation of Data Augmentation to Improve Performance CNN Method for Detecting Diabetic Retinopathy. 2020 3rd International Conference on Information and Communications Technology (ICOIACT), 83–88. https://doi.org/10.1109/ICOIACT50329.2020.9332019

Bold, N., Zhang, C., & Akashi, T. (2019). Bird Species Classification with Audio-Visual Data using CNN and Multiple Kernel Learning. 2019 International Conference on Cyberworlds (CW), 85–88. https://doi.org/10.1109/CW.2019.00022

Boral, Y. S., & Thorat, S. S. (2021). Classification of Diabetic Retinopathy based on Hybrid Neural Network. Proceedings - 5th International Conference on Computing Methodologies and Communication, ICCMC 2021, Iccmc, 1354–1358. https://doi.org/10.1109/ICCMC51019.2021.9418224

Brown, D. M., Wykoff, C. C., Boyer, D., Heier, J. S., Clark, W. L., Emanuelli, A., Higgins, P. M., Singer, M., Weinreich, D. M., Yancopoulos, G. D., Berliner, A. J., Chu, K., Reed, K., Cheng, Y., & Vitti, R. (2021). Evaluation of Intravitreal Aflibercept for the Treatment of Severe Nonproliferative Diabetic Retinopathy: Results from the PANORAMA Randomized Clinical Trial. JAMA Ophthalmology, 139(9), 946–955. https://doi.org/10.1001/jamaophthalmol.2021.2809

Dai, L., Wu, L., Li, H., Cai, C., Wu, Q., Kong, H., Liu, R., Wang, X., Hou, X., Liu, Y., Long, X., Wen, Y., Lu, L., Shen, Y., Chen, Y., Shen, D., Yang, X., Zou, H., Sheng, B., & Jia, W. (2021). A deep learning system for detecting diabetic retinopathy across the disease spectrum. Nature Communications, 12(1). https://doi.org/10.1038/s41467-021-23458-5

Erwin. (2020). Improving Retinal Image Quality Using the Contrast Stretching, Histogram Equalization, and CLAHE Methods with Median Filters. International Journal of Image, Graphics and Signal Processing, 12(2), 30–41. https://doi.org/10.5815/ijigsp.2020.02.04

Goodfellow, I., Bengio, Y., & Courville, A. (2016). Deep Learning. MIT press. http://www.deeplearningbook.org

Hagos, M. T., & Kant, S. (2019). Transfer Learning based Detection of Diabetic Retinopathy from Small Dataset. http://arxiv.org/abs/1905.07203

Hagos, M. T., Kant, S., & Bala, S. A. (2020). Automated Smartphone Based System for Diagnosis of Diabetic Retinopathy. ArXiv, 256–261.

Kwan, C. (2019). Object Tracking and Classification in Videos Using Compressive Measurements. Proceedings of the 3rd International Conference on Vision, Image and Signal Processing, 1–6. https://doi.org/10.1145/3387168.3387188

Liang, X., Qiao, X., & Li, Y. (2019). Obstructive Sleep Apnea Detection Using Combination of CNN and LSTM Techniques. 2019 IEEE 8th Joint International Information Technology and Artificial Intelligence Conference (ITAIC), 1733–1736. https://doi.org/10.1109/ITAIC.2019.8785833

Manliguez, C. (2016). Generalized Confusion Matrix for Multiple Classes Generalized Confusion Matrix for Multiple Classes The total numbers of false negative ( TFN ), false positive ( TFP ), and true negative ( TTN ) for each class i will be calculated based on the Generalized. November, 5–7. https://doi.org/10.13140/RG.2.2.31150.51523

Qomariah, D. U. N., Tjandrasa, H., & Fatichah, C. (2019). Classification of diabetic retinopathy and normal retinal images using CNN and SVM. Proceedings of 2019 International Conference on Information and Communication Technology and Systems, ICTS 2019, 152–157. https://doi.org/10.1109/ICTS.2019.8850940

Reguant, R., Brunak, S., & Saha, S. (2021). Understanding inherent image features in CNN-based assessment of diabetic retinopathy. Scientific Reports, 11(1), 1–13. https://doi.org/10.1038/s41598-021-89225-0

Safi, H., Safi, S., Hafezi-Moghadam, A., & Ahmadieh, H. (2018). Early detection of diabetic retinopathy. Survey of Ophthalmology, 63(5), 601–608. https://doi.org/10.1016/j.survophthal.2018.04.003

Shanthi, T., & Sabeenian, R. S. (2019). Modified Alexnet architecture for classification of diabetic retinopathy images. Computers & Electrical Engineering, 76, 56–64. https://doi.org/10.1016/j.compeleceng.2019.03.004

Shete, M., Sabnis, S., Rai, S., & Birajdar, G. (2020). Diabetic Retinopathy Severity Detection using Convolutional Neural Network. ITM Web of Conferences, 32(August), 01012. https://doi.org/10.1051/itmconf/20203201012

Soomro, T. A., Mahmood Khan, T., Khan, M. A. U., Gao, J., Paul, M., & Zheng, L. (2018). Impact of ICA-Based Image Enhancement Technique on Retinal Blood Vessels Segmentation. IEEE Access, 6(c), 3524–3538. https://doi.org/10.1109/ACCESS.2018.2794463

Szegedy, C., Liu, W., Jia, Y., Sermanet, P., Reed, S., Anguelov, D., Erhan, D., Vanhoucke, V., & Rabinovich, A. (2015). Going deeper with convolutions. Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 07-12-June, 1–9. https://doi.org/10.1109/CVPR.2015.7298594

Tajudin, N. M. A., Kipli, K., Mahmood, M. H., Lim, L. T., Awang Mat, D. A., Sapawi, R., Sahari, S. K., Lias, K., Jali, S. K., & Hoque, M. E. (2022). Deep learning in the grading of diabetic retinopathy: A review. IET Computer Vision, May. https://doi.org/10.1049/cvi2.12116

Taufiqurrahman, S., Handayani, A., Hermanto, B. R., & Mengko, T. L. E. R. (2020). Diabetic Retinopathy Classification Using A Hybrid and Efficient MobileNetV2-SVM Model. IEEE Region 10 Annual International Conference, Proceedings/TENCON, 2020-Novem, 235–240. https://doi.org/10.1109/TENCON50793.2020.9293739

Tsiknakis, N., Theodoropoulos, D., Manikis, G., Ktistakis, E., Boutsora, O., Berto, A., Scarpa, F., Scarpa, A., Fotiadis, D. I., & Marias, K. (2021). Deep learning for diabetic retinopathy detection and classification based on fundus images: A review. Computers in Biology and Medicine, 135, 104599. https://doi.org/10.1016/j.compbiomed.2021.104599

Wang, J., & Perez, L. (2017). The Effectiveness of Data Augmentation in Image Classification using Deep Learning. Computer Vision and Pattern Recognition.

Wysocka-Mincewicz, M., Gołębiewska, J., Olechowski, A., & Szalecki, M. (2021). Diabetic retinopathy in children with type 1 diabetes—occurrence and screening using optical coherence tomography. Life, 11(6), 1–9. https://doi.org/10.3390/life11060590

Zhang, Y. D., Dong, Z., Chen, X., Jia, W., Du, S., Muhammad, K., & Wang, S. H. (2019). Image based fruit category classification by 13-layer deep convolutional neural network and data augmentation. Multimedia Tools and Applications, 78(3), 3613–3632. https://doi.org/10.1007/s11042-017-5243-3




DOI: http://dx.doi.org/10.35671/telematika.v15i2.2086

Refbacks



 


Indexed by:

   

Telematika
ISSN: 2442-4528 (online) | ISSN: 1979-925X (print)
Published by : Universitas Amikom Purwokerto
Jl. Let. Jend. POL SUMARTO Watumas, Purwonegoro - Purwokerto, Indonesia


Creative Commons License This work is licensed under a Creative Commons Attribution 4.0 International License .