4716

Super-resolution MR Vessel Wall Images Using deep learning
Wenjing Xu1, Sen Jia1, Qing Zhu2, Yikang Li3, Hongying Zhang4, Shuai Shen1, Fuliang Lin1, Ye Li1, Dong Liang1, Xin Liu1, Hairong Zheng1, and Na Zhang1
1Paul C. Lauterbur Research Center for Biomedical Imaging, Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences, Shenzhen, China, 2Faculty of Information Technology, Beijing University of Technology, Beijing, China, 3Department of computing,Imperial College London, London, United Kingdom, 4Department of Radiology, Northern Jiangsu People's Hospital, Jiangsu, China

Synopsis

To develop a super-resolution method based on the 3D high-resolution MR vessel wall images for generating high-resolution images from low-resolution, a 3D complex-valued super resolution (CVSR) neural network was proposed, which maintained complex algebraic structure of the original acquired images. CVSR was trained on 20 pairs of data sets and tested on 5 pairs. Ground truth with 0.44 mm were compared with Fourier interpolation method, EDSR with two real-valued channels and CVSR. Evaluations were performed using structural similarity (SSIM), peak signal-to-noise ratio (PSNR), and error map quality metrics. The CVSR achieved the best performance when compared with the other methods.

INTRODUCTION

MR vessel wall imaging can directly image and evaluate arterial vessel walls and plaques. Since the intracranial arteries, especially the perforator arteries are very fine tissues. MR vessel wall imaging requires very high spatial resolution to accurately detect and evaluate vessel walls and plaques. However, MRI spatial resolution, image signal-to-noise ratio and scan time are mutually restricted. High spatial resolution imaging requires a very long scan time to obtain acceptable image quality for clinical diagnosis. Long scanning time is prone to image motion artifacts and could not satisfy clinical diagnosis. Recently, many studies have proposed the use of deep learning for high resolution reconstruction of MRI images. As we know, in MRI, k-space data are complex values with a real and an imaginary component [1]. Most of these studies do not really use the complex-valued characteristics of k-space [2]. This work proposed a complex value based deep convolution neural network (CNN) which preserves both the magnitude information and phase information of the data for super-resolution reconstruction of MR vessel wall images.

METHODS

The 0.44 mm isotropic 3D high-resolution MR vessel wall images were acquired from 25 subjects on a 3T whole-body MR system (TrioTim, Siemens, Germany). The matrix size is 448×448×352 or 416 depending on the head size. Then the corresponding 0.88 mm isotropic low-resolution images were reconstructed by truncating the acquired k-space of the high-resolution images. The 25 pairs of data sets were devided into 20 pairs of data sets for training and 5 pairs for testing. Due to the different matrix sizes of the acquired data sets, all datasets were uniformly cropped to a consistent size of 448×448×352 and used as input for training the network. Each data set was further divided into smaller patches of size 64×64×64 with a stride of 32 to adapt to the limited computation ability of our equipment. A 3D complex value based super resolution CNN entitled CVSR was proposed and trained on the training dataset including low-resolution and high-resolution data pairs to transform low-resolution MR vessel wall images into high-resolution images. The architecture of the proposed CVSR is displayed in Figure 1. The training of CVSR was performed utilizing 8 residual blocks with 64 feature channels, and the size of each kernel is 5 × 5 × 5. Structural similarity (SSIM), peak signal-to-noise ratio (PSNR) and root mean square error (RMSE) were used to evaluate the performance of the proposed CVSR model.

RESULTS

The quantitative analysis results of performance of the Fourier interpolation, EDSR with two real-valued channels and the proposed CVSR for super-resolution reconstruction of MR vessel wall images were summarized in Table1. The proposed CVSR achieved a SSIM of 0.7710, PSNR of 28.83, and RMSE of 0.1354, which were higher than those achieved by EDSR and Fourier interpolation. These evaluation metrics achieved by Fourier interpolation were the lowest. Figure 2 shows a representative coronal slice of the acquired 0.44 mm isotropic high-resolution images (ground truth), and the corresponding super-resolution images by Fourier interpolation, EDSR and CVSR. The super-resolution image obtained by CVSR is visually comparable to the ground truth for the depiction of vessel wall, and is significantly better than the image obtained by Fourier interpolation, and is also better than the super-resolution image obtained by EDSR. The reason is CVSR uses both real and imaginary information of the data and hence can recover more fine textural details and a higher signal-to-noise ratio than the other methods. Figure 3 shows the corresponding k-space data of the Figure 2 and the difference of Fourier interpolation, EDSR and CVSR relative to the ground truth. As can be seen from Figure 3 (D), there are more high-frequency signal of CVSR than the other two methods. The minMIP images for visualizing perforator arteries obtained from ground truth,Fourier interpolation, EDSR and CVSR are shown in Figure 4. Compared with the Fourier interpolation and EDSR, CVSR shows more perforator arteries details. There are discontinuous and missing perforator arterial segments of the images obtained by Fourier interpolation and EDSR, while images obtained by CVSR displays perforating vessels more clearly and closer to the ground truth.

DISCUSSION

In this study, a complex value based CNN (CVSR) which preserves both the magnitude information and phase information of the data was proposed for super resolution reconstruction of MR Vessel Wall Images. It was capable of transforming low-resolution images into high-resolution images and be able to observe the fine arteries more clearly, particularly for the perforator arteries. The CVSR achieved the best performance in super-resolution reconstruction of MR Vessel Wall Images when compared with Fourier interpolation and EDSR with two separate real-valued channels.

CONCLUSION

The proposed CVSR can transform low-resolution images into high-resolution and obtain satisfactory super-resolution MR vessel wall images. It not only shows the arterial vessel wall more clearly but also shows more details and the numbers of perforator arteries, which is of great significance for assisting clinically accurate diagnosis of fine tissues, especially arterial vessel wall and plaque.

Acknowledgements

The study was partially support by National Natural Science Foundation of China (81830056), Key Laboratory for Magnetic Resonance and Multimodality Imaging of Guangdong Province (2020B1212060051), Shenzhen Basic Research Program (JCYJ20180302145700745 and KCXFZ202002011010360), and Guangdong Innovation Platform of Translational Research for Cerebrovascular Diseases.

References

[1] Zhang Z , Wang H , Feng X , et al. Complex-Valued Convolutional Neural Network and Its Application in Polarimetric SAR Image Classification[J]. IEEE Transactions on Geoscience and Remote Sensing, 2017, PP(12):1-12.

[2] Eun D I , Jang R , Ha W S , et al. Deep-learning-based image quality enhancement of compressed sensing magnetic resonance imaging of vessel wall: comparison of self-supervised and unsupervised approaches[J]. Scientific Reports, 2020, 10(1):13950.

Figures

Figure 1: The architecture of the CVSR network.

Figure 2: A representative coronal slice of the acquired 0.44 mm isotropic high-resolution images (ground truth), and the corresponding super-resolution images by Fourier interpolation, EDSR, and CVSR. (A) ground truth, (B) Fourier interpolation, (C) EDSR with two separate real-valued channels, (D) CVSR.

Figure 3: The corresponding k-space data of Figure 2 (top row) and the difference images of Fourier interpolation, EDSR, and CVSR relative to the ground truth (bottom row). (A) ground truth, (B) Fourier interpolation, (C) EDSR with two separate real-valued channels, (D) CVSR.

Figure 4: The minMIP images for visualizing perforator arteries obtained from ground truth,Fourier interpolation, EDSR and CVSR. (A) ground truth, (B) Fourier interpolation, (C) EDSR with two separate real-valued channels, (D) CVSR.

Figure 5: The quantitative analysis results of performance of the Fourier interpolation, EDSR with two real-valued channels and the proposed CVSR for super-resolution reconstruction of MR vessel wall images

Proc. Intl. Soc. Mag. Reson. Med. 30 (2022)
4716
DOI: https://doi.org/10.58530/2022/4716