Segmentation of Human Brain Gliomas Tumour Images using U-Net Architecture with Transfer Learning

Assalah Zaki  Atiyah; Khawla  Hussein Ali

doi:10.24237/djes.2022.15102

Authors

Assalah Zaki Atiyah
pgs2179@uobasrah.edu.iq
Department of Computer Science, College of Education for Pure Sciences, University of Basrah, 42001 Basrah, Iraq
Khawla Hussein Ali Department of Computer Science, College of Education for Pure Sciences, University of Basrah, 42001 Basrah, Iraq.

Keywords:

Gliomas images, MRI segmentation, Brain tumor, U-Net, Transfer learning , BraTS2020

Abstract

The complexity of segmenting a brain tumour is critical in medical image processing. Treatment options and patient survival rates can only be improved if brain tumours can be prevented and treated. Segmentation of the brain is the most complex and time-consuming task to diagnose cancer utilizing a manual approach for numerous magnetic resonance images (MRI). The aim of MRI brain tumour image segmentation that to build an automated magnetic resonance imaging tumour segmentation system with separate the area of tumour and provided a clear boundary of the tumour region. U-Nets with different transfer learning models as backbones are presented in this paper, there are ResNet50, DenseNet169 and EfficientNet-B7. Brain lesion segmentation is performed using the multimodal brain tumor segmentation challenge 2020 dataset (BraTS2020). Based on MRI scans of the brain, the tumor segmentation technique is assessed using F₁-score, Dice loss, and intersection over union score (IoU). The U-Net encoder used with EfficientNet-B7 outperforms all other architectures in terms of performance metrics across the board. Overall, the results of this experiment are rather excellent. The Dice-loss score was 0.009435, and the score of IoU was 0.7435, F₁-score was 0.9848, accuracy was 0.9924, precision was 0.9829, recall was 0.9868, and specificity was 0.9943. The U-Net with EfficientNet-B7 architecture was shown to be crucial in the treatment of brain tumors, according to the findings of the experiments

Downloads

Download data is not yet available.

References

S. Han,“Brain Tumor: Types, Risk Factors, and Symptoms, Diagnosis, Treatment,” [Online], June 6, 2017. Available: https://www.healthline.com/health/brain-tumor.

A. Z. Atiyah and K. H. Ali, “ Brain MRI Images Segmentation Based on U-Net Architecture,” IJEEE Journal, pp. 21-27, 2021. DOI: https://doi.org/10.37917/ijeee.18.1.3

O. Ronneberger, Philipp Fischer, and T. Brox, “U-Net: Convolutional Networks for Biomedical Image Segmentation,” CoRR, vol. abs/1505.0, pp. 16591–16603, 2015.

H. Dong, G. Yang, F. Liu, Y. Mo, and Y. Guo, “Automatic brain tumor detection and segmentation using U-net based fully convolutional networks,” Commun. Comput. Inf. Sci., vol. 723, pp. 506–517, 2017. DOI: https://doi.org/10.1007/978-3-319-60964-5_44

R. A. Zeineldin, M. E. Karar, J. Coburger, C. R. Wirtz, and O. Burgert, “DeepSeg: deep neural network framework for automatic brain tumor segmentation using magnetic resonance FLAIR images,” Int. J. Comput. Assist. Radiol. Surg., vol. 15, no. 6, pp. 909–920, 2020. DOI: https://doi.org/10.1007/s11548-020-02186-z

X. Feng, N. J. Tustison, S. H. Patel, and C. H. Meyer, “Brain Tumor Segmentation Using an Ensemble of 3D U-Nets and Overall Survival Prediction Using Radiomic Features,” Front. Comput. Neurosci., vol. 14, no. April, pp. 1–12, 2020. DOI: https://doi.org/10.3389/fncom.2020.00025

T. Sadad, “Brain tumor detection and multi-classification using advanced deep learning techniques,” Microsc. Res. Tech., no. October 2020, pp. 1296–1308, 2021. DOI: https://doi.org/10.1002/jemt.23688

F. Isensee, P. F. Jäger, P. M. Full, P. Vollmuth, and K. H. Maier-Hein, “nnU-Net for Brain Tumor Segmentation,” pp. 118–132, 2021. DOI: https://doi.org/10.1007/978-3-030-72087-2_11

P. K. Gadosey , “SD-UNET: Stripping down U-net for segmentation of biomedical images on platforms with low computational budgets,” Diagnostics, vol. 10, no. 2, pp. 1–18, 2020. DOI: https://doi.org/10.3390/diagnostics10020110

A. A. Pravitasari, N. Iriawan, M. Almuhayar, T. Azmi, Irhamah, K. Fithriasari, S. W. Purnami, W. Ferriastuti, “UNet-VGG16 with transfer learning for MRI-based brain tumor segmentation,” Telkomnika, vol. 18, no. 3, pp. 1310~1318,2020. DOI: https://doi.org/10.12928/telkomnika.v18i3.14753

K. He, X. Zhang, S. Ren, and J. Sun, “Deep residual learning for image recognition,” Proc. IEEE Comput. Soc. Conf. Comput. Vis. Pattern Recognit., vol. 2016-Decem, pp. 770–778, 2016. DOI: https://doi.org/10.1109/CVPR.2016.90

G. Huang, Z. Liu, G. Pleiss, L. van der Maaten, and K. Q. Weinberger, “Densely Connected Convolutional Networks,” IEEE Trans. Pattern Anal. Mach. Intell., 2020.

M. Tan and Q. V. Le, “EfficientNet: Rethinking model scaling for convolutional neural networks,” 36th Int. Conf. Mach. Learn. ICML, vol. 2019-June, pp. 10691–10700, 2019.

“Intersection over Union (IoU) for object detection – PyImageSearch,” [Online], Jul. 16, 2021,Available: https://www.pyimagesearch.com.

“F-Score Definition | DeepAI,” [Online], Jul. 16, 2021, Available: https://deepai.org/machine-learning-glossary-and-terms/f-score.

“An overview of semantic image segmentation,” [Online], Jul. 16, 2021, Available: https://www.jeremyjordan.me/semantic-segmentation.

C. Lyu and H. Shu, “A Two-Stage Cascade Model with Variational Autoencoders and Attention Gates for MRI Brain Tumor Segmentation,”. arXiv preprint arXiv:2011.02881,2020. DOI: https://doi.org/10.1007/978-3-030-72084-1_39