3601

Rapid Region-of-Interest MRI Reconstruction Using Context-Aware Non-Local U-Net
Xinwen Liu1, Jing Wang1,2, Fangfang Tang1, Hongfu Sun1, Feng Liu1, and Stuart Crozier1
1School of Information Technology and Electrical Engineering, the University of Queensland, Brisbane, Australia, 2School of Information and Communication Technology, Griffith University, Brisbane, Australia

Synopsis

In MRI, region-of-interest (ROI) imaging is frequently used in clinical applications. The sub-sampling-based scheme is capable of accelerating the ROI-focused image reconstruction process but degrades the image quality. The degradation could be alleviated by ROI-weighted optimization; however, existing methods mainly focus on the local signal restoration and have no explicit control of the noise from the entire image. In this abstract, we propose to reconstruct the ROI using a non-local U-net method that incorporates contextual information from the whole image. The results show the proposed algorithm improves PSNR and SSIM over conventional methods.

Introduction

Large field-of-view (FOV) is typically implemented during MRI acquisition to avoid the fold-over artifacts, however, only the region of interest (ROI) is needed for many clinical purposes. For example, cardiac imaging requires a large FOV but only the region containing heart is of the interest[1]. This also applies to prostate imaging, where the whole pelvis MRI scan is needed. The large FOV slows down the acquisition process, leading to motion artifacts and discomfort for the patients. To accelerate the imaging process, less data is sampled and then the de-aliasing algorithm is applied to reconstruct high-quality images. Algorithms that reconstruct the full FOV images are capable of producing good results with high peak signal-to-noise ratio (PSNR) and structure similarity index (SSIM) on the whole images. However, these metrics are normally worse in the ROI. This is mainly because these ‘global’ algorithms optimize the reconstruction for full FOV, rather than the ROI.

Earlier works[1, 2] on ROI-specific reconstruction used the weighting techniques to constrain the optimization in the local region during the iterative optimization process. While the ROI-weighted objective function improves image quality, the entire image signal context is not explicitly considered for a further improved result. The contextual information in full FOV images is important to recover the ROI because local area is corrupted by signals leaked from the entire image under Gaussian sub-sampling pattern. In other words, the sub-sampling process inevitably causes local-global interference on the aliased image. The signal interference in the image domain has not been explicitly investigated in previous works, leading to compromised ROI reconstruction quality. In this work, we propose a deep learning-based ROI de-aliasing algorithm, where the local-global signal dependencies are considered using the designed non-local blocks. Results show the proposed method outperforms the full image reconstruction in ROI with increased SSIM and PSNR.

Methods

To reconstruct the ROI image with contextual information, we propose a de-aliasing network that takes the aliased image as input and outputs the reconstructed ROI. The network has a U-net[3] as the backbone with a non-local block[4] inserted in the expanding path, and we name it as non-local U-net. Table 1 shows the configuration of the proposed network architecture.

In an aliased image, the signal leakage from one pixel spreads across the whole image. Therefore, the aliased ROI contains signal from the local area and the full FOV image under the Gaussian sub-sampling pattern. To restore the fully-sampled ROI, all pixels in the full image domain need to be explicitly considered. Inspired by the idea of non-local means in image denoising, a non-local block[4] is designed to include all pixels in the operation. The non-local block is shown in Figure 1 and can be expressed as: $$$y_{i}= \frac{1}{C(x)}\sum\limits_{∀j}f(x_{i},x_{j})g(x_{j})$$$, where $$$x$$$ is the input feature, $$$y$$$ is the output feature, subscription $$$i$$$ and $$$j$$$ are index positions of pixels, $$$f(x_{i},x_{j})$$$ is the embedded Gaussian function describing the similarity between two pixels, $$$g(x_{j} )=W_{g} x_{j}$$$ is a representation of input where $$$W_{g}$$$ is to be learnt in the training process, and $$$C(x)$$$ is the normalization factor. We can see for a specific pixel $$$x_{i}$$$, the output $$$y_{i}$$$ comes from the calculation of all pixels.

Results and Discussion

We used the ACDC dataset[5] to train and test the proposed algorithm. 395 two-dimensional slices of high quality were selected from 50 subjects. We randomly split the dataset into 320 slices for training and 75 slices for testing and reporting results. The image was resized to 256-by-256, and the intensity was normalized to 0~1. We simulated the one-dimensional Gaussian sub-sampling process with acceleration rates of 6 by applying the corresponding binary mask to k-space. Figure 2 shows the ground truth image and the zero-padded image. The red square denotes the ROI.

We evaluate the algorithm on the testing set and report average results in this section. PSNR and SSIM are used to evaluate the reconstruction results on ROI. We conducted two experiments to show the effectiveness of the proposed algorithm. Firstly, we trained the full FOV images using U-net that outputs the full FOV and evaluated the results only on the ROI containing a heart. The second test was conducted on the proposed method, which outputs the ROI. The qualitative comparison between the two tests is shown in Figure 3, and the quantitative comparison is shown in Table 2. We can see the introduction of one non-local block improves the image quality of ROI reconstruction.

Conclusion

We have proposed a ROI MRI reconstruction method using a non-local U-net incorporating context information of the full FOV image. The proposed algorithm achieves improved SSIM and PSNR in the ROI reconstruction compared to the conventional full FOV reconstruction.

Acknowledgements

No acknowledgement found.

References

[1] A. S. Konar et al., "Region of interest compressed sensing MRI," Journal of the Indian Institute of Science, vol. 94, no. 4, pp. 407-414, 2014.

[2] L. Sun, Z. Fan, X. Ding, Y. Huang, and J. Paisley, "Region-of-interest undersampled MRI reconstruction: A deep convolutional neural network approach," Magnetic resonance imaging, vol. 63, pp. 185-192, 2019.

[3] O. Ronneberger, P. Fischer, and T. Brox, "U-net: Convolutional networks for biomedical image segmentation," in International Conference on Medical image computing and computer-assisted intervention, 2015: Springer, pp. 234-241.

[4] X. Wang, R. Girshick, A. Gupta, and K. He, "Non-local neural networks," in Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2018, pp. 7794-7803.

[5] O. Bernard et al., "Deep learning techniques for automatic MRI cardiac multi-structures segmentation and diagnosis: Is the problem solved?," IEEE Transactions on Medical Imaging, vol. 37, no. 11, pp. 2514-2525, 2018.

Figures

Table 1: Non-local U-net configuration.

Figure 1: Illustration of non-local block.

Figure 2: Visualization of the fully-sampled image and zero-padded image with acceleration rates = 6. The red square is the ROI selected.

Figure 3: Illustration of ROI reconstruction results and the error map.

Table 2: Comparison results between the full FOV reconstruction and the proposed method.

Proc. Intl. Soc. Mag. Reson. Med. 28 (2020)
3601