Published 2023-12-27
Keywords
- Image Fusion,
- Modified-UNet (MUNet),
- Multi-cascaded Convolutional Neural Network (MCCNN) with fully connected Condiional Random Fields(CRFs),
- Modified Fully Connected Layer (MFCL),
- Tissue-Aware Conditional Generative Adversarial Network (TA-cGAN)
- Ensemble Learning ...More
Copyright (c) 2023

This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.
Abstract
Image fusions are that join medical images from many modalities like CTS (Computed Tomography Scans) and MRI (Magnetic Resonance Imaging) with the aim of presenting better clinical content to clinicians and doctors for planning treatments or therapies. Prior studies based on white images have showed issues in early predictions of brain tumours like inaccurate image. This study attempts to overcome this issue by comparing MUNets (Modified-UNets), MCNNs (Multi-Cascaded ConvolutionNeural Networks) with fully connected CRFs (Conditional Random Fields), MFCLs (Modified Fully Connected Layers), TA-cGANs (Tissue-Aware conditional Generative Adversarial Networks) and EL (Ensemble Learning) algorithms. Furthermore, in order to enhance image quality and enable the early diagnosis of brain tumours, novel multimodal medical image fusion techniques are being examined. Furthermore, it is suggested that the EL algorithm improve MRI brain image fusion performance. The four primary phases of the suggested system are segmentation, image synthesis, feature extraction, and noise reduction. To eliminate noises, AMFs (Adaptive Median Filters) are used for reducing noises in MRI images and thus assist in enhancing classification accuracies. These features are taken into segmentation process using RGKMC (Region Growing based K-Means Clustering). Feature extractions are performed using AFFOCNNs (Adaptive FireFly Optimization based Convolution Neural Networks) algorithm which computes necessary and prominent features. Subsequently, MCCNNs, MUNets, MFCLs, TAcGANs and EL algorithms are applied for classifications through training and testing models. They classify features more accurately using their informative features. The experimental result proves that ELalgorithms provides better classificationsthan the MCCNNs, MUNets, MFCLs and TA-cGANs when evaluated in terms of higher accuracies, precisions, recalls and reduced MSEs (Mean Square Errors), execution times
References
- . Liu, Z., Yin, H., Chai, Y., & Yang, S. X. (2014). A novel approach for multimodal medical image fusion. Expert systems with applications, 41(16), 7425-7435
- . Arif, Muhammad, and Guojun Wang. "Fast curvelet transform through genetic algorithm for multimodal medical image fusion." Soft Computing 24.3 (2020): 1815-1836.
- . Zhao, Wenda, Dong Wang, and Huchuan Lu. "Multi-focus image fusion with a natural enhancement via a joint multi-level deeply supervised convolutional neural network." IEEE Transactions on Circuits and Systems for Video Technology 29.4 (2018): 1102-1115
- . Polinati, Srinivasu, et al. "The Fusion of MRI and CT Medical Images Using Variational Mode Decomposition." Applied Sciences 11.22 (2021): 10975.
- . Liu, Yu, et al. "Multi-focus image fusion with a deep convolutional neural network." Information Fusion 36 (2017): 191-207
- . Yan, Chenggang, et al. "Deep multi-view enhancement hashing for image retrieval." IEEE Transactions on Pattern Analysis and Machine Intelligence 43.4 (2020): 1445-1451
- . Tan, Wei, et al. "Multi-modal brain image fusion based on multi-level edge-preserving filtering." Biomedical Signal Processing and Control 64 (2021): 102280
- . Verma, Kesari, Bikesh Kumar Singh, and A. S. Thoke. "An enhancement in adaptive median filter for edge preservation." Procedia Computer Science 48 (2015): 29-36
- . Ibrahim, Haidi, Nicholas SiaPik Kong, and Theam Foo Ng. "Simple adaptive median filter for the removal of impulse noise from highly corrupted images." IEEE Transactions on Consumer Electronics 54.4 (2008): 1920-1927
- . Sulaiman, SitiNoraini, and NorAshidi Mat Isa. "Adaptive fuzzy-K-means clustering algorithm for image segmentation." IEEE Transactions on Consumer Electronics 56.4 (2010): 2661-2668
- . Liu, Changnian, et al. "Adaptive firefly optimization algorithm based on stochastic inertia weight." 2013 Sixth International Symposium on Computational Intelligence and Design. Vol. 1. IEEE, 2013
- . Liu, Jingsen, et al. "A dynamic adaptive firefly algorithm with globally orientation." Mathematics and Computers in Simulation 174 (2020): 76-101
- . Havaei, M., Davy, A., Warde-Farley, D., Biard, A., Courville, A., Bengio, Y., ...&Larochelle, H. (2017). Brain tumor segmentation with deep neural networks. Medical image analysis, 35, 18-31.
- . Prakash, Om, RichaSrivastava, and AshishKhare. "Biorthogonalwavelet transform based image fusion using absolute maximum fusion rule." 2013 IEEE Conference on Information & Communication Technologies. IEEE, 2013
- . Wang, Yan, et al. "3D conditional generative adversarial networks for high-quality PET image estimation at low dose." Neuroimage 174 (2018): 550-562
- . Goodfellow, I., Pouget-Abadie, J., Mirza, M., Xu, B., Warde-Farley, D., Ozair, S., ...&Bengio, Y. (2020). Generative adversarial networks. Communications of the ACM, 63(11), 139-144.
- . Kang, Jiayin, Wu Lu, and Wenjuan Zhang. "Fusion of brain PET and MRI images using tissue-aware conditional generative adversarial network with joint loss." IEEE Access 8 (2020): 6368-6378
- . Hu, Kai, et al. "Brain tumor segmentation using multi-cascaded convolutional neural networks and conditional random field." IEEE Access 7 (2019): 92615-92629.