0167

Unsupervised correction network for Nyquist ghost artifact and geometry distortion in echo planar imaging
Jeewon Kim1, Kinam Kwon1, Seohee So2, Byungjai Kim1, Wonil Lee1, and HyunWook Park1
1Korea Advanced Institute of Science and Technology (KAIST), Daejeon, Korea, Republic of, 2Korea Institute of Science and Technology, Seoul, Korea, Republic of

Synopsis

We propose a new correction scheme using a deep neural network with unsupervised learning to correct Nyquist ghosts and geometry distortions occurring in EPI. The proposed scheme includes NGAC-net and GDC-net. First, the NGAC-net estimates the phase error of k-space with the help of a ghost formulation operator and correlation loss. The NGAC-net produces two Nyquist ghost corrected images obtained by dual-polarity phase-encoding gradients. The GDC-net is trained to estimate the frequency-shift map using the two output images from the NGAC-net. Afterwards, an MR image generation operator utilizes the estimated frequency-shift map to obtain the geometry distortion corrected images.

Introduction

Echo planar imaging (EPI) is a fast imaging sequence that was developed to address the slow MR imaging time1. However, EPI is considerably distorted by the field inhomogeneity, resulting in two different types of artifacts: Nyquist ghost artifact and geometry distortion along the phase-encoding direction. However, correcting EPI image distortion is crucial since spatial registration in DTI and fMRI requires undeformed images. Attempts to correct Nyquist ghost artifacts, such as acquiring additional navigator signals and using referenceless methods have been studied2-3. However, these methods require additional imaging time and priori data to correct Nyquist ghost artifacts. To correct geometry distortion, many approaches have been explored such as obtaining field inhomogeneity maps through additional scans, using dual-polarity readout gradients, and applying neural networks4-6. However, these methods require additional imaging time and large training datasets. To counter these issues, Kim et al. developed an unsupervised learning method without labeled data and reduced the correction time by inferencing with the pretrained network. However, this method could only correct mild geometry distortion 7. We attempt to correct both Nyquist artifacts and even severe geometry distortions with unsupervised learning.

Method

The overall scheme of the proposed method, shown in Fig.1, is composed of two networks: a Nyquist ghost artifact correction network (NGAC-net) and a geometry distortion correction network (GDC-net). The details of the networks are presented in Fig.2. An image acquired with the single-shot spin-echo EPI sequence which has Nyquist ghost artifacts can be written as follows3:
$$I_g = I_f\cos(\phi_0+\frac{\pi s}{N_x}x)+iI'_f\sin(\phi_0+\frac{\pi s}{N_x}x)=F_{gh}(I_f,s,\phi_0),\hspace{0.5cm}(1),$$
where $$$F_gh$$$ denotes a ghost formulation operator, $$$I_f$$$ is the ideal ghost-free image, and $$$I'_f$$$ indicates the image shifted with FOV/2 along the phase-encoding direction. Then, the ghost-free image can be obtained with the estimated time delay ($$$s$$$) and constant phase ($$$\phi_0$$$) as follows: $$$I_f=F_{gh}(I_g,-s,-\phi_0)$$$.
By minimizing the correlation coefficient loss function ($$$\mathcal{L_{corr}} = {corr_{I_f}}/{corr_{I_g}}$$$), the NGAC-net is trained to estimate $$$s$$$ and $$$\phi_0$$$ that are used to correct the Nyquist ghost artifact. The $$$corr_{I_f}$$$ is the 2D correlation coefficient between the upper and lower half parts of the image $$$I$$$. Since, $$$corr_{I_g}$$$ has ghost signals along the phase-encoding direction, the $$$corr_{I_g}$$$ is higher than that of the ghost corrected image $$$corr_{I_f}$$$.
As shown in Fig.3A, to generate training datasets for NGAC-net, the Gaussian filtered CIFAR-100 data are used to simulate phase map ($$$\theta$$$), and the ImageNet 2012 data are masked with a brain shape to simulate proton density maps ($$$\rho$$$)8-9.
In previous work, Kim et al. showed that a geometry distortion-free image could be obtained with half of the estimated frequency-shift maps ($$$\delta \omega_+/2,\ \ \delta \omega_-/2$$$) between the two distorted images obtained by dual-polarity phase-encoding gradients ($$$I_+,\ \ I_-$$$)7. The mean absolute error between the input distorted images ($$$I_+,\ \ I_-$$$) and the estimated distorted images ($$$\hat{I_+},\ \ \hat{I_-}$$$), is minimized to optimize the GDC-net for estimating the frequency-shift maps.
Here, unlike the previous work, we use two types of datasets to make the GDC-net able to correct severe geometry distortion. Type 1 is the mild distortion case induced by a smoothed field inhomogeneity map, and type 2 has more severe distortion to simulate local susceptibility effects. The brain-shape masked ImageNet 2012 data are used to represent proton density maps, and the resized and Gaussian filtered CIFAR-100 data are used to represent frequency-shift maps which are induced by the field inhomogeneity effects8-9. As shown in Fig.3B, the frequency-shift maps are smoothed a lot with a Gaussian filter, so that the distortion of the proton density map is mild. Indeed, when EPI images are obtained, the geometric distortion due to the field inhomogeneity is relatively small at the top of the head, whereas slices near the eyes are severely distorted and exhibit large pile up due to the field inhomogeneity generated by large susceptibility difference, such as air in the nasal cavity10. To demonstrate this effect, a type 2 training dataset that had severe pile-up and geometry distortion was prepared as illustrated in Fig.3C.

Results and discussion

Fig.4 shows the Nyquist ghost corrected images obtained by the 3-line navigator method, the G/O minimization method, and the proposed method. The corrected images acquired from both positive and negative polarity phase-encoding gradients ($$$I_+,\ \ I_-$$$) are shown in Fig.4. A quantitative comparison was made with the ghost-to-signal-ratio (GSR).
Fig. 5 shows the geometry distortion-corrected images from the topup11 and the proposed methods. Due to the $$$B_0$$$ field inhomogeneity, the anterior parts of the brains in both $$$I_+$$$ and $$$I_-$$$ are distorted. The anterior of the brain shifts inside for $$$I_+$$$ and outside for $$$I_-$$$. Compared to the turbo spin-echo image, which could be considered as a visually correct ground truth image, the topup and the proposed methods effectively produced geometry distortion-corrected brain images. The proposed method can perform fast computation by utilizing pre-trained weights of the network for the correction of EPI images.

Conclusion

We proposed an unsupervised EPI distortion correction network that did not require labeled images in the training phase. We acquired training datasets by the MATLAB simulation of readily available images such as ImageNet2012 and CIFAR-100. Even though the network has not been trained with MRI data, it successfully works for distortion-corrected EPI images.

Acknowledgements

This work was supported by the Korea Medical Device Development Fund grant funded by the Korea government (the Ministry of Science and ICT, the Ministry of Trade, Industry and Energy, the Ministry of Health & Welfare, the Ministry of Food and Drug Safety) (Project Number: 1711138003, KMDF-RnD KMDF_PR_20200901_0041-2021-02).

References

1. Poustchi-Amin, M., Mirowitz, S. A., Brown, J. J., McKinstry, R. C., Li, T. Principles and applications of echo-planar imaging: a review for the general radiologist. Radiographics. 21(3), 767-779, 2001.

2. Heid O, inventor; Siemens Healthcare GmbH, assignee. Method for the phase correction of nuclear magnetic resonance signals. US patents 6,043,651. Mar 28, 2000.

3. McKay, J. A., Moeller, S., Zhang, L., Auerbach, E. J., Nelson, M. T., Bolan, P. J. Nyquist ghost correction of breast diffusion weighted imaging using referenceless methods. Magnetic resonance in medicine. 81(4), 2624-2631, 2019.

4. Holland, D., Kuperman, J. M., Dale, A. M. Efficient correction of inhomogeneous static magnetic field-induced distortion in Echo Planar Imaging. Neuroimage. 50(1), 175-183, 2010.

5. P.S. Morgan, R.W. Bowtell, D.J. McIntyre, B.S. Worthington, Correction of spatial distortion in EPI due to inhomogeneous static magnetic fields using the reversed gradient method, J. Magnetic resonance in medicine. 19 (4) (2004) 499–507.

6. Liao, P., Zhang, J., Zeng, K., Yang, Y., Cai, S., Guo, G., & Cai, C. Referenceless distortion correction of gradient-echo echo-planar imaging under inhomogeneous magnetic fields based on a deep convolutional neural network. Computers in biology and medicine. 100, 230-238, 2018.

7. Kim, J., Kwon, K., Kim, B., Kim, S., Park, H. Unsupervised deep learning method for EPI distortion correction using dual-polarity phase-encoding gradients. International Society for Magnetic Resonance in Medicine (ISMRM), 2020.

8. Krizhevsky, A., Hinton, G. Learning multiple layers of features from tiny images. Technical report, University of Toronto, vol.1, No.4, p.7, 2009.

9. Russakovsky, O., Deng, J., Su, H., Krause, J., Satheesh, S., Ma, S., ... Berg, A. C. Imagenet large scale visual recognition challenge. International journal of computer vision. 115(3), 211-252, 2015.

10. Jezzard P, Balaban RS. Correction for geometric distortion in echo planar images from B0 field variations. Magnetic resonance in medicine. 34(1), 65-73, 1995.

11. Andersson, J. L., Skare, S., Ashburner, J. How to correct susceptibility distortions in spin-echo echo-planar images: application to diffusion tensor imaging. Neuroimage. 20(2), 870-888, 2003.

Figures

Figure 1. Schematic diagram of the proposed method. The Nyquist ghost artifacts are corrected in each single-shot spin-echo EPI image from dual-polarity phase-encoding gradients by the NGAC-net. Second, the GDC-net performs geometry distortion correction using two Nyquist ghost artifact corrected images of positive and negative polarity EPI.

Figure 2. Schematic diagram of the deep neural networks. (A) NGAC-net, and (B) GDC-net. Abbreviations: BN: batch normalization, Conv: convolutional layer, Max pool: max pooling layer, ReLU: rectified linear unit, Up‐conv: up‐sampling layer, Concatenate: concatenate layer, Flatten: flatten layer, Dense: dense layer

Figure 3. (A) Synthesis of the training datasets from natural images for NGAC-net. The proton density map phase-shifted by the phase map ($$$\rho \times e^{-i\theta}$$$) is used to simulate ghost artifact images with the ghost formulation operator in Eq.1. (B-C) Synthesis of training dataset from natural images for GDC-net. (B) mildly distorted case (Type 1), and (C) severely distorted case (Type 2)

Figure 4. The Nyquist ghost artifact corrected images from 3-line Navigator method (3-lin Nav), G/O minimization method (G/O), and the proposed method. GSR value is also written on the bottom right in each image.

Figure 5. The geometry distortion corrected images from the topup and the proposed methods. SSIM value is written on the bottom right of each image. $$$I_+$$$: images acquired from positive polarity phase-encoding gradients, $$$I_-$$$: images acquired from negative polarity phase-encoding gradients.

Proc. Intl. Soc. Mag. Reson. Med. 30 (2022)
0167
DOI: https://doi.org/10.58530/2022/0167