3169

Multi-contrast Brain MRI Image Super-resolution with Gradient-guided Edge Enhancement
Hong Zheng1, Kun Zeng1, Di Guo2, Jiaxi Ying1, Yu Yang1, Xi Peng3, Zhong Chen1, and Xiaobo Qu1

1Department of Electronic Science, Xiamen University, Xiamen, China, 2Xiamen University of Technology, Xiamen, China, 3Institutes of Advanced Technology, Chinese Academy of Sciences, Shenzhen, China

Synopsis

Since magnetic resonance imaging (MRI) can offer images of an object with different contrasts, e.g., T1-weighted or T2-weighted, the shared information between inter-contrast images can be used to benefit super-resolution. Multi-contrast images are assumed to possess the same gradient direction in a local pattern. We proposed to establish a relation model of gradient value between different contrast images, to restore a high-resolution image from its input low-resolution version. The similarity of image patches is employed to estimate intensity parameters, leading a more accurate reconstructed image. Then, iterative back-projection filter is applied to the reconstructed image to further increase image quality. The reconstructed edges are more consistent to the original high-resolution image, indicated with higher PSNR and SSIM than the compared methods.

Purpose

In magnetic resonance imaging (MRI), low-resolution images may be acquired and their resolutions can be improved by applying super-resolution methods. MRI usually offer images of an object with different contrasts, e.g. T1-weighted or T2-weighted imaging (Fig. 1). Thus the shared information between inter-contrast images can be used to benefit super-resolution [1]. In this paper, we first establish a gradient relation model among different contrast images and then reconstruct the super-resolved edges by incorporating the gradient information from another contrast high-resolution image. Brain image edges are further improved with similar patches estimation and iterative back-projection filter. The reconstructed edges are more consistent to the original high-resolution image, indicated with higher peak signal-to-noise ratio (PSNR) and structure similarity index (SSIM) [2] than the compared methods.

Methods

Multi-contrast images $$${\bf{\tilde X}}$$$ and $$${\bf{\tilde R}}$$$ are assumed to possess the same gradient direction in a local pattern. We proposed to establish a relation model of gradient value between different contrast images (Fig. 2), to restore a high-resolution image from its input low-resolution version. Assuming that an adjustment parameter $$${\delta _{i,j}}$$$ is added to the (i, j) pixel $$${X_{i,j}}$$$ of a pre-interpolated image $$${\bf{X}}$$$ , our model can be expressed as $$\begin{array}{l} \mathop {\min }\limits_{{\delta _{i,j}}} {\kern 1pt} {\kern 1pt} {\kern 1pt} {\{ {\kern 1pt} [g({X_{i,j}} + {\delta _{i,j}}) - g({X_{i,j}})] - \lambda {\kern 1pt} {\kern 1pt} [g({{\tilde R}_{i,j}}) - g({R_{i,j}})]\} ^2}\\ {\kern 1pt} {\kern 1pt} {\kern 1pt} {\kern 1pt} {\kern 1pt} {\kern 1pt} {\kern 1pt} {\kern 1pt} {\kern 1pt} {\kern 1pt} {\kern 1pt} {\kern 1pt} {\kern 1pt} {\kern 1pt} {\kern 1pt} {\kern 1pt} {\kern 1pt} {\kern 1pt} {\kern 1pt} {\kern 1pt} {\kern 1pt} {\kern 1pt} {\kern 1pt} {\kern 1pt} + {\{ [{g_ \bot }({X_{i,j}} + {\delta _{i,j}}) - {g_ \bot }({X_{i,j}})] - {\lambda _ \bot }{\kern 1pt} {\kern 1pt} [{g_ \bot }({{\tilde R}_{i,j}}) - {g_ \bot }({R_{i,j}})]\} ^2} \end{array} (1)$$ where $$$g\left( \cdot \right)$$$ is a second order gradient function, $$${\tilde X_{i,j}}$$$ is the pixel of $$${\bf{\tilde X}}$$$, and $$${\tilde R_{i,j}}$$$ is the pixel of $$${\bf{\tilde R}}$$$. $$${R_{i,j}}$$$ is the pixel of $$${\bf{R}}$$$, which is the pre-interpolated image of LR version of $$${\bf{\tilde R}}$$$. The $$$\lambda $$$ and $$${\lambda _ \bot }$$$ are parameters that adjusting intensity in gradient direction and the edge direction. In here, their values are estimated as SRGR model [3] as $$\begin{array}{l} \lambda = ({X_{i + 1,j - 1}} - {X_{i - 1,j + 1}})/{\kern 1pt} {\kern 1pt} {\kern 1pt} ({{\tilde R}_{i + 1,j - 1}} - {{\tilde R}_{i - 1,j + 1}}){\kern 1pt} {\kern 1pt} {\kern 1pt} {\kern 1pt} {\kern 1pt} {\kern 1pt} {\kern 1pt} \\ {\lambda _ \bot } = ({X_{i - 1,j - 1}} - {X_{i + 1,j + 1}})/{\kern 1pt} {\kern 1pt} {\kern 1pt} ({{\tilde R}_{i - 1,j - 1}} - {{\tilde R}_{i + 1,j + 1}}){\kern 1pt} .{\kern 1pt} {\kern 1pt} {\kern 1pt} {\kern 1pt} {\kern 1pt} {\kern 1pt} {\kern 1pt} {\kern 1pt} {\kern 1pt} {\kern 1pt} {\kern 1pt} {\kern 1pt} {\kern 1pt} {\kern 1pt} {\kern 1pt} \end{array} (2)$$ The proposed model finds refinements on pixels to minimize the gradient difference between the HR images and HR reference images. The similarity of image patches [1, 4-5] is employed to estimate intensity parameters, leading a more accurate reconstructed image. Then, iterative back-projection (IBP) filter [6] is applied to the reconstructed image to further increase image quality.

Results

Experimental results on synthetic MRI images are presented in Fig. 3. The new approach, whether without IBP or with IBP, achieves higher visual quality and higher objective quality criteria (PSNR and SSIM [2]) than the compared state-of-the-art super-resolution approaches.

Conclusions

The gradient information of the multi-contrast MRI images is very useful. With a proper relation model, the proposed method enhances image edges in MRI image super-resolution.

Acknowledgements

This work was supported by the National Key R&D Program of China (2017YFC0108700), National Natural Science Foundation of China (61571380, U1632274 and 61302174), Natural Science Foundation of Fujian Province of China (2016J05205). The correspondence should be sent to Dr. Xiaobo Qu (Email: quxiaobo@xmu.edu.cn).

References

1. Qu. X., et al., Undersampled MRI reconstruction with patch-based directional wavelets. Magn. Reson. Imaging, 2012, 30(7): 964-977.

2. Wang. Z., et al., Image quality assessment: From error visibility to structural similarity. IEEE Trans. Image Process., 2004,13(4):600-612.

3. Shi. C., et al., Learning interpolation via regional map for pan-sharpening. IEEE Trans. Geosci. Remote. Sens., 2015, 53(6): 3417-3431.

4. Qu. X., et al., Magnetic resonance image reconstruction from undersampled measurements using a patch-based nonlocal operator. Med. Image Anal., 2014, 18(6):843-856.

5. Zhan. Z., et al., Fast multi-class dictionaries learning with geometrical directions in MRI reconstruction. IEEE Trans. Biomed. Eng., 2016, 63( 9): 1850-1861.

6. Irani. M., et al., Motion analysis for image enhancement: resolution, occlusion, and transparency. J. Vis. Commun. Image Represent, 1993, 4(4): 324-335.

7. Wei. Z., et al., Contrast-guided image interpolation. IEEE Trans. Image Process, 2013, 22(11): 4271-4285.

8. Zheng. H., et al., Muti-contrast brain magnetic resonance image super-resolution using the local weight similarity. BMC Medical Imaging, 2017, 17(1), DOI: 10.1186/s12880-016-0176-2.

Figures

Fig. 1. Multi-contrast MR images. (a) and (b) are T1 and T2 images.

Fig. 2 Illustration for the proposed model in a local pattern. (a) is the target HR image $$${\bf{\tilde X}}$$$; (b) is the HR reference image $$${\bf{\tilde R}}$$$ with different contrast; (c) is the pre-interpolated image $$${\bf{X}}$$$ obtained from the low observation of $$${\bf{\tilde X}}$$$; (d) is the pre-interpolated image $$${\bf{R}}$$$ obtained from the low observation of $$${\bf{\tilde R}}$$$; (e) An example of the gradient direction $$$l$$$. Note: In estimation, a more accurate pixel, e.g. $$${X_{i,j}} + {\delta _{i,j}}$$$, indicated by dark circles within (c) is used to replace the pre-interpolated HR pixel, e.g. $$${X_{i,j}}$$$, to generate a better HR image.

Fig. 3 Interpolated images and their PSNR/SSIM. (a)-(e) are super-resolved images using the bicubic method (21.20/0.8086), CGI [7] (23.74/0.8818), ILWS [8] (22.71/0.8627), the proposed method without IBP (24.17/0.8956), and the proposed method with IBP (25.94/0.9259), respectively. (f) The ground truth image (HR of T2).

Proc. Intl. Soc. Mag. Reson. Med. 26 (2018)
3169