3608

Efficient Phase-varied Image Reconstruction using Single Deep Convolutional Neural Network without Estimation of Phase Distribution.
Shohei OUCHI1 and Satoshi ITO1
1Utsunomiya University, Utsunomiya, Japan

Synopsis

A novel single image domain learning CNN based reconstruction method for phase-varied images is proposed in which real and imaginary part of complex image are reconstructed independently. Proposed method uses symmetrical sub-sampling which enable reconstruction for real and imaginary part of complex images independently of each other without estimating phase distribution on the image. Reconstruction experiments showed that higher PSNR images are obtained in proposed method compared to phase estimating CNN or ADMM-CSNet. Proposed method is highly practical since it is robust to phase variation and is easy for training because of its simple CNN structure

Introduction

MR images have phase distribution due to inhomogeneities of static field strength and the difference of magnetic susceptibility, therefore image reconstruction must consider phase on the image as well as its magnitude. D. Lee et al. proposed deep convolutional neural network (CNN) reconstruction in which magnitude and phase distribution are reconstructed independently[1], and Y. Yang et al. proposed ADMM-CSnet for reconstructing phase varied images using multi-layer network [2]. Since phase function is periodical ($$$-\pi, \pi$$$) non smooth function, it is not easy to estimate precise distribution from under-sampled signal, and ADMM-CSnet require quite long time for learning the manner of artifacts appearances. In this paper, we propose a novel CNN image reconstruction in the information of phase distribution is not required and complex images can be reconstructed using only real-value single CNN.

Method

MR signal $$$s({\bf k})$$$ can be expressed as Eq.(1) ,

$$s({\bf k})=\int \rho({\bf x}) e^{-j \phi({\bf x})} e^{-j({\bf k \cdot x)}} d{\bf x}\nonumber ={\cal F}\left[ \rho({\bf x}) e^{-j \phi({\bf x})} \right] ...(1),$$

where $$$\bf k$$$ is a k-space vector and $$$\bf x$$$ is a space vector, $$$\rho({\bf x})$$$ is spin density distribution, $$$\phi({\bf x})$$$ is the function of phase variation due to imperfection in the MRI equipment and inhomogeneities in the main static magnetic field and $$${\cal F}$$$ is the operator of the Fourier transform.
The real and imaginary part of the complex image $$$\rho({\bf x}) \exp^{-j \phi({\bf x})} $$$ can be written as follows:

$${\cal F}\left\{ {\rm Re} \left[ \rho({\bf x}) e^{-j \phi({\bf x)}} \right] \right\} =\!\frac{1}{2}{\cal F}\left\{ \rho({\bf x}) e^{-j \phi({\bf x)}}\!\! +\!\! \rho({\bf x}) e^{j \phi({\bf x)}} \right\} =\frac{1}{2} \left\{ s({\bf k})+s({-\bf k})^{*} \right\} ...(2),$$ $${\cal F}\left\{{\rm Im}\! \left[ \rho({\bf x}) e^{-j \phi({\bf x)}} \right] \right\} =-\frac{j}{2} {\cal F}\left\{ \rho({\bf x}) e^{-j \phi({\bf x)}}\!\! - \!\! \rho({\bf x}) e^{j \phi({\bf x)}} \right\} =-\frac{j}{2} \left\{ s({\bf k})-s(-{\bf k})^{*} \right\} ...(3),$$

In this paper, we focus on Cartesian grid sampling, which is the most widely used technique. If a symmetrical signal sampling with respect to the origin of k-space is executed as shown in Fig.1, then the real and imaginary part of complex image can be reconstructed independently of each other by corresponding signal [3], which means that estimation of phase distribution on the image is unnecessary and real-value constraint can be used in each part of image. Based on these relation, a novel compressed sensing image reconstruction method is proposed in which real and imaginary part of complex images are reconstructed independently using a single CNN. Since estimation of phase distribution is not necessary and real-value constraint can be used in the reconstruction procedure, proposed method is robust to phase changes on the image and easy for training of images. Figure 2 show the structure of proposed method. For the architecture of CNN, residual learning and batch normalization [4] was used for learning. The depth of CNN was set 30 and corresponding receptive field size was 61x61. Three types of layers were used, (1) Conv+ReLU: for the first layer, 64 filters of size 3 x 3, 2) Conv+BN+ReLU: for layers 2 ~ 29, 64 filters of size 3 x 3 x 64, 3) Conv: for the last layer, 3x3x64 filter were used. Data consistency step is incorporated at the end of network since each part of complex image correspond to signal calculated using the relation of Eq.(2) and (3).

Results & Discussions

MR normal volunteer images were collected using a Toshiba 1.5T MRI scanner. MR signals are calculated using the acquired phase varied images by applying Fourier transform in the simulation experiments. Real part and imaginary part of complex images are used together for the training of single CNN. The number of images for CNN training is 50 including real part and imaginary part of 25 complex images. Various phase images with rapid or slow phase changes are used for CNN training. Figure 3 shows the representative results using 30% and 40% signal with various phase images. It was shown that fairly good images with small aliasing artifacts are obtained irrespective of the magnitude of phase change. We compared the peak-signal-to-noise ratio (PSNR) of obtained images with other reconstruction methods; magnitude and phase CNN (Mag&phase) method [1], ADMM-CSNet [2] and iterative phase and magnitude optimization method (CS iter) [5]. Symmetrical k-space random sampling was used for proposed method and other methods use non-symmetrical random sampling. The results of PSNR evaluation is summarized in Fig.4 and the comparison of reconstructed images using 30% signal are shown in Fig.5. Reconstruction time of each method is shown inside the parenthesis. Reconstructed images, error mages and enlarged images are shown in top, middle and bottom rows, respectively. Remained aliasing artifacts are very small and details of the object are reconstructed well in proposed method. Figure 4 shows that highest PSNRs are obtained in proposed method in all signal sampling rates.

Conclusion

A novel phase varied image reconstruction method using symmetrical k-space sampling with single CNN is proposed. It was demonstrated that high quality images with smaller artifacts were obtained. Proposed method is highly practical since it is robust to phase variation and is easy for training because of its simple CNN structure.

Acknowledgements

This study was supported in part by JSPS KAKENHI(19K04423). We would like to thank Canon Medical Systems.

References

1. D. Lee et al. Deep Residual Learning for Accelerated MRI Using Magnitude and Phase Networks, IEEE Tran BME 2018; 65:1985-1995.

2. Y. Yang et al., ADMM-CSNet: A Deep Learning Approach for Image Compressive Sensing, IEEE Tran PAMI, doi: 10.1109/TPAMI.2018.2883941.

3. S. Ito et al., An Efficient Compressed Sensing Reconstruction Robust to Phase Variation on MR Images, ISMRM2013, 2604, Salt lake city, USA.

4. K. Zhang et al., Beyond a Gaussian Denoiser: Residual Learning of Deep CNN for Image Denoising. IEEE Tran Image Proc 2017; 26, 3142-3155

5. F. Zhao et al., Separate Magnitude and Phase Regularization via Compressed Sensing, IEEE Tran Med Imag 2012, 31: 1713-1723.

Figures

Fig.1 Symmetrical signal subsampling with respect to the origin of k-space that is used in proposed method.

Fig.2 Schematic of phase-varied image reconstruction using single CNN. Symmetrical subsampling with respect to k-space origin is executed. Real and imaginary part of complex image are reconstructed using single CNN by corresponding signals. Image domain learning CNN with data consistency step is used. Both real and imaginary part of complex images are used for training CNN and the trained network can be used both real and imaginary part of image reconstruction.

Fig.3 Reconstructed images of several phase variations for 30% and 40% signals; (a) phase map of fully scanned images, (b) magnitude images of fully scanned image, (c) reconstructed images in proposed method, (d) and (c) are enlarged images of (b) and (c), respectively. Details of images are restored well and conspicuous aliasing artifacts are not seen on the reconstructed images.

Fig.4 Comparison of PSNR between proposed method, ADMM-CSNet, magnitude and phase CNN and CS iterative reconstruction using magnitude and phase optimization.

Fig.5 Comparison of reconstructed images between proposed method, ADMM-CSNet, magnitude and phase CNN and CS iterative reconstruction using magnitude and phase optimization. Middle row images are phase map and error images of each methods, bottom row shows the enlarged images shown in red box. Reconstruction time is shown under each method.

Proc. Intl. Soc. Mag. Reson. Med. 28 (2020)
3608