0848

Deep Learning Reconstruction for FRONSAC
Zhehong Zhang1 and Gigi Galiana2
1Department of Biomedical Engineering, Yale University, New Haven, CT, United States, 2Department of Radiology and Biomedical Imaging, Yale University, New Haven, CT, United States

Synopsis

This work is the first to apply deep learning to the reconstruction of images encoded with nonlinear gradients. We apply a model-based deep learning network (MoDL) to simulated FRONSAC images and compare these to a PSF-based matrix inversion as well as cg-SENSE. The MoDL based reconstruction did not significantly change the behavior of signal noise. However, results demonstrate that the model-based deep learning network can outperform traditional reconstruction methods at high undersampling factors. Simulations also suggests that the regularizing network has potential to correct for miscalibration in the nonlinear gradient trajectory.

Introduction

Like coil weighting in parallel imaging, nonlinear gradient encoding enables the sampled data to be interpreted as a weighted sum of adjacent k-space data points, making it helpful to fill in the trajectory gaps in k-space, especially when combined with coil sensitivity encoding in parallel imaging1. Fast Rotary Nonlinear Spatial Acquisition (FRONSAC) is an imaging approach that applies a rapidly oscillating nonlinear gradient waveform during readout and has been shown to provide imaging acceleration while maintaining the reliability of a standard Cartesian acquisition2,3. Previous work has demonstrated the feasibility of reconstructing FRONSAC data via iterations over the full encoding matrix, as well as by inversion of the PSF modulation seen in a transform of the data4,5.

Previous work has shown that deep learning reconstruction can produce faster reconstruction with reduced noise and artifacts in both Cartesian and non-Cartesian trajectories, but these points have not been explored under nonlinear gradient encoding. In particular, FRONSAC typically requires a rigorous field mapping of the nonlinear gradient, so improved robustness against potential trajectory errors might lower this requirement.

Here we study the utility of reconstructing FRONSAC with MoDL, incorporating the FRONSAC encoding matrix in the MoDL reconstruction network6. We present studies of whether MoDL reconstruction suppresses noise, allows for greater undersampling, or improves robustness to errors in the nonlinear field mapping. To our knowledge, this is the first work using deep learning reconstruction for nonlinear gradient imaging.

Method

Model-based imaging schemes map and image x to the sensor domain data y using an encoding matrix A.
$$y=A(x)$$
In FRONSAC imaging, $$$A=P F Psf S$$$, where $$$P$$$ is the sampling operator, $$$F$$$ is the Fourier transform, $$$S$$$ is the multiplication with the sensitivities. $$$Psf$$$ is determined by nonlinear gradient channels and the corresponding phase trajectory.
$$Psf_{x,y,z}(\omega)=F^{-1}(exp(i2\pi P_{nlg}(x,y,z,t)))$$
We formulate the reconstruction of the image as an optimization problem consisting of data consistency term and regularization term $$x_{rec}=arg min||A(x)-y||_2^2+\lambda||(I-D_w)(x)||^2$$
where $$$D_w$$$ is the denoiser to remove alias artifacts and noise.

This problem can be solved as$$x_{n+1} = (A^HA+\lambda I)^{-1}(A^H(y)+\lambda D_w(x_n))$$
In many cases, the operator of $$$(A^HA+\lambda I)$$$ is not analytically invertible, so this problem often needs to be solved using a numerical optimization scheme.

An unrolled recursive algorithm forms the deep learning network, MoDL-FRONSAC, as is shown in Figure 1. Each residual learning based denoiser block, which collects image information, consists of a 6-layer model with 64 filters at each layer. The following data consistency blocks enforce consistency with acquired data where conjugate gradient optimization is used instead of analytical inversion of $$$(A^HA+\lambda I)$$$. The model is unrolled assuming 4 iterations of the optimization problem. The training is end-to-end, and the loss function is the mean squared error between predicted images and ground truth.

The network was trained on retrospectively undersampled 2D brain magnetic resonance images selected from the Human Connectome Project (HCP)7. 100 images were divided into training, validation, and test dataset with a ratio of 3:1:1. Experimental sensitivity maps from an 8 channel coil and an experimentally measured FRONSAC trajectory5 were used in data simulation. The reconstruction implementation was based on the package Deepinpy8.

Different levels of Gaussian noise were added to the signal to study the effect of noise. At a fixed noise level, we also tested different undersampling factors, training a new denoiser for each case of undersampling. The results of MoDL-FRONSAC were compared to the PSF-based reconstruction method as well as conjugate gradient SENSE. To study the correction of errors in the nonlinear gradient trajectory, a single $$$D_w$$$ was trained with a range of FRONSAC gradient waveforms. For each test set, errors in the trajectory of the nonlinear gradient were simulated by scaling the FRONSAC gradient in the data generation step without making any changes in the reconstruction pipeline.

Results and Discussion

Figure 2 tabulates metrics across the test dataset for varying levels of signal noise. In this implementation, performance relative to Gaussian noise is fairly similar for PSF-based and MoDL reconstructions, which are both improvements on the CG-SENSE results.

Figure 3 shows results from the study of undersampling performance at a fixed noise level. Results are similar at modest undersampling factors. However, at R=8 the DL layer of MoDL appears to rescue the image and remove the most prominent aliasing artifacts, though some noise-like image degradation is still apparent.

Finally, Figure 4 shows results simulating a scale factor between the FRONSAC gradient used to generate data and the FRONSAC gradient used in the reconstruction. While both reconstruction methods show some image degradation with increasing trajectory errors, NRMSE and PSNR are both better with MoDL reconstruction. Difference images also reveal a more distributed artifact, which may be amenable to additional regularization strategies.

Conclusion

This work demonstrates that MoDL reconstruction can improve images acquired with nonlinear encoding. The results show substantial improvements at high undersampling factors, and they also demonstrate that the denoising network can be trained to correct for artifacts arising from specific trajectory errors. This latter feature is particularly important as it may reduce mapping requirements for nonlinearly encoded imaging strategies.

Acknowledgements

The authors thank Kalina Slavkova and Jon Tamir for guidance, as well as NIH NIBIB Grant EB022030 for funding support.

References

1. Galiana, Gigi, et al. "The role of nonlinear gradients in parallel imaging: A k‐space based analysis." Concepts in Magnetic Resonance Part A 40.5 (2012): 253-267.

2. Wang, Haifeng, et al. "Fast rotary nonlinear spatial acquisition (FRONSAC) imaging." Magnetic resonance in medicine 75.3 (2016): 1154-1165.

3. Dispenza, Nadine L., et al. "Clinical potential of a new approach to MRI acceleration." Scientific reports 9.1 (2019): 1-10.

4. Bilgic, Berkin, et al. "Wave‐CAIPI for highly accelerated 3D imaging." Magnetic resonance in medicine 73.6 (2015): 2152-2162.

5. Rodriguez, Yanitza, et al. "3D FRONSAC with PSF reconstruction." arXiv:2111.05143 [physics.med-ph]

6. Aggarwal, Hemant K., Merry P. Mani, and Mathews Jacob. "MoDL: Model-based deep learning architecture for inverse problems." IEEE transactions on medical imaging 38.2 (2018): 394-405.

7. Fan, Qiuyun, et al. "MGH–USC Human Connectome Project datasets with ultra-high b-value diffusion MRI." Neuroimage 124 (2016): 1108-1114.

8. Tamir, Jonathan I., et al. " DeepInPy: Deep Inverse Problems in Python" In: Proceedings 28th Scientific Meeting, ISMRM. 2020.

Figures

Figure 1: Network architecture: This work applied the MoDL network to FRONSAC imaging, so the encoding matrix was modified to include an experimentally measured FRONSAC gradient waveform during each readout. Blocks enforcing data consistency were iteratively alternated with DL blocks that denoise the image, which is based on the network shown below.

Figure 2: PSNR and NRMSE across the 20 images in the test dataset when Ry=4: PSF reconstruction and MoDL show similar performance as a function of noise, though direct inversion seems to provide some advantages in the low noise case. Both methods yield better reconstructions than CG-SENSE with 16 iterations.

Figure 3: Undersampled reconstructions: All methods perform adequate reconstruction at lower undersampling factors. However, at this moderately high noise level, R=8 with 8 coils is challenging even with FRONSAC encoding. The additional regularization provided by the denoising network is still able to provide a promising reconstruction, greatly outperforming the PSF and CG-SENSE results. PSNR and RMSE are averages across the 20 images of the test set.

Figure 4: Sensitivity to errors in the FRONSAC gradient mapping: MoDL reconstructions show greater resilience to errors in the trajectory of the nonlinear FRONSAC gradient, as evidenced by better higher PSNR, lower NRMSE, and more diffuse difference images. Current implementations of FRONSAC use a rigorous field mapping technique, but a more robust reconstruction approach may relax those requirements. All metrics are means over the 20 images in the test set.

Proc. Intl. Soc. Mag. Reson. Med. 30 (2022)
0848
DOI: https://doi.org/10.58530/2022/0848