Toward Improving Knee MRI Image Quality for Single Image Super-resolution

Hafssa Mediani, Salma Tayeb, Soufiana Mekouar, Mohammed Majid Himmi
Pages 2810-2822
Abstract Views 421
PDF Downloads 493
Crossref Citations -
DOI https://doi.org/10.47738/jads.v6i4.926

Abstract


This study aims to improve image super-resolution techniques by balancing distortion reduction with perceptual quality improvement. It introduces a new framework called Toward Improving Super-Resolution, which focuses on producing high-quality knee magnetic resonance images. The framework uses a lightweight, resolution-independent, feedforward convolutional network with 266,000 parameters, which includes smoothing and denoising preprocessing and Leaky Rectified Linear Unit activations for stable training. The model builds on a baseline deep learning architecture to improve training stability and visual quality while maintaining computational efficiency. The fast Magnetic Resonance Imaging knee dataset was compared to established super-resolution methods like Super-Resolution Convolutional Neural Network, Very Deep Super-Resolution, and Enhanced Deep Super-Resolution. Toward Improving Super-Resolution achieved a peak signal-to-noise ratio of 38.405 ± 0.129 decibels and a structural similarity index of 0.9815 ± 0.0021, surpassing Super-Resolution Convolutional Neural Network, Very Deep Super-Resolution, and Enhanced Deep Super-Resolution. It maintained high performance at scales three and four, demonstrating accuracy and statistical robustness. The study shows that the proposed framework can enhance diagnostic imaging, reduce the need for repeated scans, and speed up clinical decision-making.


Keywords


Magnetic Resonance Imaging (MRI); Super-Resolution (SR); Deep Neural Network; Low Resolution (LR); High Resolution (HR)

Full Text:

PDF

References


R. Girshick, J. Donahue, T. Darrell, J. Malik, Region-based convolutional networks for accurate object detection and segmentation, IEEE Transactions on Pattern Analysis and Machine Intelligence 38 (1) (2016) 142–158. doi:10.1109/TPAMI.2015.2437384.

Y. Bai, Y. Zhang, M. Ding, B. Ghanem, Sod-mtgan: Small object detection via multi-task generative adversarial network, in: Proceedings of the European Conference on Computer Vision (ECCV), 2018.

H. Greenspan, Super-Resolution in Medical Imaging, The Computer Journal 52 (1) (2008) 43–63. arXiv:https://academic.oup.com/ comjnl/article-pdf/52/1/43/1153004/bxm075.pdf, doi:10.1093/ comjnl/bxm075. URL https://doi.org/10.1093/comjnl/bxm075

C. J. Lillesand TM, Kiefer RW, Remote Sensing and Image Interpretation / Thomas M. Lillesand (Emeritus, University of WisconsinMadison), Ralph W. Kiefer (Emeritus, University of WisconsinMadison), Jonathan W. Chipman (Darthmouth College)., Seventh edition. Wiley; 2015.

A. P. Lobanov, Resolution limits in astronomical images (2005). arXiv:astro-ph/0503225.URL https://arxiv.org/abs/astro-ph/0503225

A. Swaminathan, M. Wu, K. R. Liu, Digital image forensics via intrinsic fingerprints, IEEE Transactions on Information Forensics and Security 3 (1) (2008) 101–117. doi:10.1109/TIFS.2007.916010.

F. Lin, J. D. Rojas, P. A. Dayton, Super resolution contrast ultrasound imaging: Analysis of imaging resolution and application to imaging tumor angiogenesis, in: 2016 IEEE International Ultrasonics Symposium (IUS), 2016, pp. 1–4. doi:10.1109/ULTSYM.2016.7728735.

D. Mahapatra, B. Bozorgtabar, R. Garnavi, Image super-resolution using progressive generative adversarial networks for medical image analysis, Computerized Medical Imaging and Graphics 71 (2019) 30–39. doi:https://doi.org/10.1016/j.compmedimag.2018.10.005. URL https://www.sciencedirect.com/science/article/pii/ S0895611118305871

D. J. Brenner, E. J. Hall, Computed tomography — an increasing source of radiation exposure, New England Journal of Medicine 357 (22) (2007) 2277–2284. arXiv:https://www.nejm.org/doi/pdf/10.1056/ NEJMra072149, doi:10.1056/NEJMra072149. URL https://www.nejm.org/doi/full/10.1056/NEJMra072149

C. Dong, C. C. Loy, K. He, X. Tang, Image super-resolution using deep convolutional networks (2015). arXiv:1501.00092. URL https://arxiv.org/abs/1501.00092.

J. Kim, J. K. Lee, K. M. Lee, Accurate image super-resolution using very deep convolutional networks, in: 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2016, pp. 1646–1654. doi: 10.1109/CVPR.2016.182.

B. Lim, S. Son, H. Kim, S. Nah, K. M. Lee, Enhanced deep residual networks for single image super-resolution (2017). arXiv:1707.02921. URL https://arxiv.org/abs/1707.02921

S. T. Roweis, L. K. Saul, Nonlinear dimensionality reduction by locally linear embedding, Science 290 (5500) (2000) 2323–2326.arXiv:https://www.science.org/doi/pdf/10.1126/science.290.5500.2323, doi:10.1126/science.290.5500.2323. URL:https://www.science.org/doi/abs/10.1126/science.290. 5500.2323

H. Chang, D.-Y. Yeung, Y. Xiong, Super-resolution through neighbor embedding, in: Proceedings of the 2004 IEEE Computer Society Confer-ence on Computer Vision and Pattern Recognition, 2004. CVPR 2004 ., Vol. 1, 2004, pp. I–I. doi:10.1109/CVPR.2004.1315043.

S. Yang, Z. Wang, L. Zhang, M. Wang, Dual-geometric neighbor embedding for image super resolution with sparse tensor, IEEE Transactions on Image Processing 23 (7) (2014) 2793–2803. doi:10.1109/TIP.2014. 2319742.

J. Yang, J. Wright, T. S. Huang, Y. Ma, Image super-resolution via sparse representation, IEEE Transactions on Image Processing 19 (11) (2010) 2861–2873. doi:10.1109/TIP.2010.2050625.

J. Yang, J. Wright, T. Huang, Y. Ma, Image super-resolution as sparse representation of raw image patches, in: 2008 IEEE Conference on Computer Vision and Pattern Recognition, 2008, pp. 1 – 8. doi:10.1109/CVPR.2008.4587647.

M. P. R. Zeyde, M. Elad, in: On single image scale-up using sparserepresentations, Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics) 6920 LNCS, 2012, p. 711–730. doi:https://doi.org/10.1007/ 978-3-642-27413-8_47/COVER.

J. A. Tropp, A. C. Gilbert, Signal recovery from random measurements via orthogonal matching pursuit, IEEE Transactions on Information Theory 53 (12) (2007) 4655–4666. doi:10.1109/TIT.2007.909108.

J. Jiang, R. Hu, Z. Han, K. Huang, T. Lu, Efficient single image superresolution via graph embedding, in: 2012 IEEE International Conference on Multimedia and Expo, 2012, pp. 610–615. doi:10.1109/ICME.2012.102.

J. Jiang, R. Hu, Z. Wang, Z. Han, S. Dong, Manifold regularized sparse support regression for single image super-resolution, in: 2013 IEEE International Conference on Acoustics, Speech and Signal Processing, 2013, pp. 1429–1433. doi:10.1109/ICASSP.2013.6637887.

S. Anwar, S. Khan, N. Barnes, A deep journey into super-resolution: A survey, ACM Comput. Surv. 53 (3) (may 2020). doi:10.1145/3390462. URL https://doi.org/10.1145/3390462

Z. Wang, J. Chen, S. C. H. Hoi, Deep learning for image super-resolution: A survey, IEEE Transactions on Pattern Analysis and Machine Intelligence 43 (10) (2021) 3365–3387. doi:10.1109/TPAMI.2020.2982166.

J. Kim, J. K. Lee, K. M. Lee, Accurate image super-resolution using very deep convolutional networks (2016). arXiv:1511.04587. URL https://arxiv.org/abs/1511.04587

K. Zhang, W. Zuo, Y. Chen, D. Meng, L. Zhang, Beyond a gaussian denoiser: Residual learning of deep cnn for image denoising, IEEE Transactions on Image Processing 26 (7) (2017) 3142–3155. doi: 10.1109/TIP.2017.2662206.

K. Zhang, W. Zuo, S. Gu, L. Zhang, Learning deep cnn denoiser prior for image restoration (2017). arXiv:1704.03264. URL https://arxiv.org/abs/1704.03264

C. Dong, C. C. Loy, K. He, X. Tang, Learning a deep convolutional network for image super-resolution, in: European Conference on Computer Vision, 2014. URL https://api.semanticscholar.org/CorpusID:18874645

C. Dong, C. C. Loy, K. He, X. Tang, Image super-resolution using deep convolutional networks, IEEE Transactions on Pattern Analysis and Machine Intelligence 38 (2) (2016) 295–307. doi:10.1109/TPAMI.2015.2439281.

C. Dong, C. C. Loy, X. Tang, Accelerating the super-resolution convolutional neural network (2016). arXiv:1608.00367. URL https://arxiv.org/abs/1608.00367

Z. Luo, L. Yu, X. Mo, Y. Li, L. Jia, H. Fan, J. Sun, S. Liu, Ebsr: Feature enhanced burst super-resolution with deformable alignment, in: 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), 2021, pp. 471–478. doi:10.1109/CVPRW53098.2021.00058.

T. Wang, W. Sun, H. Qi, P. Ren, Aerial image super resolution via wavelet multiscale convolutional neural networks, IEEE Geoscience and Remote Sensing Letters 15 (5) (2018) 769–773. doi:10.1109/LGRS.2018.2810893.

W. Shi, J. Caballero, F. Husz´ar, J. Totz, A. P. Aitken, R. Bishop, D. Rueckert, Z. Wang, Real-time single image and video super-resolution using an efficient sub-pixel convolutional neural network (2016). arXiv:1609.05158. URL https://arxiv.org/abs/1609.05158

S. Liu, C. Zheng, K. Lu, S. Gao, N. Wang, B. Wang, D. Zhang, X. Zhang, T. Xu, Evsrnet: Efficient video super-resolution with neural architecture search, in: 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), 2021, pp. 2480 – 2485. doi:10.1109/CVPRW53098.2021.00281.

J. Zbontar, F. Knoll, A. Sriram, T. Murrell, Z. Huang, M. J. Muckley, A. Defazio, R. Stern, P. Johnson, M. Bruno, M. Parente, K. J. Geras, J. Katsnelson, H. Chandarana, Z. Zhang, M. Drozdzal, A. Romero, Rabbat, P. Vincent, N. Yakubova, J. Pinkerton, D. Wang, E. Owens, C. L. Zitnick, M. P. Recht, D. K. Sodickson, Y. W. Lui, fastmri: An open dataset and benchmarks for accelerated mri (2019). arXiv:1811.08839. URL https://arxiv.org/abs/1811.08839

F. Knoll, J. Zbontar, A. Sriram, M. J. Muckley, M. Bruno, A. Defazio, Parente, K. J. Geras, J. Katsnelson, H. Chandarana, Z. Zhang, M. Drozdzalv, A. Romero, M. Rabbat, P. Vincent, J. Pinkerton, D. Wang, N. Yakubova, E. Owens, C. Zitnick, P. Recht, Michael, K. Sodickson, Daniel, Y. W. Lui, fastmri: A publicly available raw k-space and dicom dataset of knee images for accelerated mr image reconstruction using machine learning, Radiology: Artificial Intelligence 2 (1) (2020) e190007, pMID: 32076662. arXiv:https://doi.org/10.1148/ryai.2020190007,doi:10.1148/ryai.2020190007.URL https://doi.org/10.1148/ryai.2020190007




DOI: https://doi.org/10.47738/jads.v6i4.926

Refbacks

  • There are currently no refbacks.


Barcode

Journal of Applied Data Sciences

ISSN:2723-6471 (Online)
Publisher:Bright Publisher
Website:http://bright-journal.org/JADS
Email:taqwa@amikompurwokerto.ac.id (principal contact)
  support@bright-journal.org (technical issues)

This work is licensed under a Creative Commons Attribution-ShareAlike 4.0