3101

B0 Inhomogeneity Distortion Corrected Image Reconstruction with Deep Learning on An Open Bore MRI-Linac
Shanshan Shan1,2, Yang Gao3,4, Meng Ma5, Hongping Gan5, David Waddington2, Brendan Whelan2, Paul Liu2, Chunyi Liu1, Mingyuan Gao1, and Feng Liu4
1Center for Molecular Imaging and Nuclear Medicine, State Key Laboratory of Radiation Medicine and Protection,School for Radiological and Interdisciplinary Sciences (RAD-X), Soochow University, Suzhou, China, 2ACRF Image X Institute, Faculty of Medicine and Health, The University of Sydney, Sydney, Australia, 3School of Computer Science and Engineering, Central South University, Changsha, China, 4School of Information Technology and Electrical Engineering, University of Queensland, Brisbane, Australia, 5School of Software, Northwestern Polytechnical University, Suzhou, China

Synopsis

Keywords: Image Reconstruction, Brain

MRI-Linac systems require real-time anatomical images with high geometric fidelity to localize and track tumours during radiotherapy treatments. Image distortions caused by B0 field inhomogeneity and slow MR acquisition hinder the application of real-time MRI-guided radiotherapy. Here, we develop and investigate a deep learning-based reconstruction pipeline to reconstruct B0 inhomogeneity distortion-corrected images (B0ReconNet) directly from k-space. MR acceleration techniques such as compressed sensing (CS) were integrated into B0ReconNet to further reduce acquisition time. Simulated and experimental data with fully sampled and retrospectively subsampled acquisitions on a 1T open bore MRI-Linac were used to validate the proposed method.

Introduction

MRI-Linac systems have been developed to enable accurate target localization and real-time tumour tracking for radiotherapy treatments [1]. The Australian 1T open bore MRI-Linac uses a split magnet design with a larger central gap (50cm) to facilitate patient positioning and treatment beam delivery [2]. However, the split bore structure compromises B0 field homogeneity, which causes image geometric distortions and potentially inaccurate dose delivery [3]. In addition, slow MR acquisition and reconstruction restrict the potential for real-time tumour tracking during radiotherapy treatments [4]. Our recently developed DCReconNet method shows deep neural networks have promises for fast and accurate image reconstruction with corrected gradient nonlinearity distortion [5]. In this work, we develop a deep learning network (B0ReconNet) to reconstruct B0 inhomogeneity distortion-corrected images directly from k-space domain. The compressed sensing (CS) technique was integrated into B0ReconNet to further reduce acquisition time. Simulated brain dataset and experimental distortion phantom images with fully sampled and retrospectively subsampled acquisitions on an MRI-Linac were used to validate the proposed method.

Method

Problem formulation
The forward gradient encoding process with B0 inhomogeneity can be formulated as [3, 6]: $$m\widetilde{F}s=b\qquad\qquad\qquad\qquad\qquad\qquad(1)$$ Where m is the undersampling matrix, b denotes the measured k-space signal, and s is the distortion-corrected image. $$$\widetilde{F}$$$represents the nonlinear Fourier transform matrix with the kernel of $$$\widetilde{e}=e^{-2\pi jk\widetilde{L}}$$$, where$$$\widetilde{L}$$$ is the distorted position caused by B0 inhomogeneity. The distorted position $$$\widetilde{L}$$$ can be found at the location $$$\widetilde{L}^{+}$$$ with a positive encoding gradient and $$$\widetilde{L}^{-}$$$ with a negative encoding gradient, governed by the equations [7] below: $$\widetilde{L}^{+}=L+\frac{dB_{0}(x,y,z)}{G_{L}} \qquad\qquad\qquad\qquad\qquad\qquad(2)$$ $$\widetilde{L}^{-}=L-\frac{dB_{0}(x,y,z)}{G_{L}} \qquad\qquad\qquad\qquad\qquad\qquad(3)$$ Where L is the undistorted position, $$$dB_{0}(x,y,z)$$$ is the B0 field deviation and $$$G_{L}$$$ is the applied gradient strength. The distortion-corrected image can be reconstructed by the penalized regression [4]:$$s=\mathop{\arg\min}_{s}\ \{\lambda P(s)+\|m\widetilde{F}s-b||_F^2\}\qquad\qquad\qquad\qquad\qquad\qquad(4)$$ Where P(s) represents a regularization function with a weighting parameter λ. Iterative regularisation algorithms can be used to solve Eq.(4), which however, have a high computational cost.
B0ReconNet
Recently, model-driven unrolling networks have shown promises in providing an accurate and rapid solution to MR reconstruction instead of using slow iterative algorithms. Unrolling networks incorporate known MR physics with well-defined interpretability. Based on an unrolling network architecture, Eq. (1) can be solved by the equation below [5]: $$s=\mathop{\arg\min}_{s}\ \{CNN(s)+\|m\widetilde{F}s-b||_F^2\}\qquad\qquad\qquad\qquad\qquad\qquad(5)$$ Where$$$\|m\widetilde{F}s-b||_F^2$$$ represents the data fidelity term, and a convolutional neural network CNN(s) was learned for effective regularizations. It is noted that $$$\widetilde{F}s$$$ represents a nonuniform Fourier transform operation, which can be calculated by Type-I Nonuniform Fast Fourier Transform (NUFFT).
Data preparation and network training
In this study, a 3D grid phantom with 3718 markers was scanned on the Australian 1T MRI-Linac system with positive and negative gradient encoding polarities to measure B0 inhomogeneity distortion. Based on the B0 measurement, a spherical harmonic expansion [8] was used to characterize the B0 field within the region of interest (ROI). 3000 T1-weighted brain images from a public MR dataset were used as training labels. Distorted brain images were simulated using Eq. (1) with acceleration factors (AF) of 2 and 4. Brain images were acquired from a whole-body MRI scanner, and the imaging parameters were: voxel size = 320 × 320 × 256, resolution = 0.7 mm × 0.7 mm × 0.7 mm, and TE/TR = 2.13 ms/2.4 s. The proposed B0ReconNet was based on the ISTA-Net architecture [8] and was trained on an Nvidia Tesla V100 GPU (32G) for 100 epochs (~10 hours) using these simulated brain images with Adam optimizer. Another 300 brain images from the same public MRI dataset were used to simulate testing data with AF=2 and AF=4. A 3D grid phantom was scanned from a 1T Australian MRI-Linac system with the imaging parameters: matrix size = 130 × 110 × 192, resolution = 1.8 mm × 2 mm × 1.8 mm, and TE/TR = 15 ms/5.1 s. Grid phantom data was retrospectively subsampled at AF=4.

Results

Fully sampled brain data with B0 inhomogeneity at different bandwidths is shown in Figure 1. Considerable geometric distortions were presented in conventional FT-reconstructed images, and more distortions resulted at lower bandwidth. By contrast, the B0ReconNet successfully reduced these distortions and resulted in minor errors (less than 10%), as indicated by the error maps. A subsampling mask with AF=2 and AF=4 was imposed on the B0 inhomogeneity-corrupted k-space data and then reconstructed by conventional CS-based regularization method, zero-filling method (ZF) and B0ReconNet. B0ReconNet achieved comparable results with the CS method at AF=2 with same root mean square error (RMSE) and structural similarity index (SSIM) values. While better structural details were preserved in the B0ReconNet-reconstructed images at AF=4, as indicated by yellow arrows. The RMSE and SSIM values were calculated on 300 testing simulated brain images at AF=4. As shown in Figure 3, the B0ReconNet provided the lowest RMSE and highest SSIM values compared with the other two methods. Experimental grid phantom results are shown in Figure 4. B0ReconNet resulted in better structural details than the CS and ZF methods. The inference time of B0ReconNet was 0.1s with GPU, making it feasible for real-time imaging applications.

Discussion and conclusion

Imaging results on simulated brain dataset and experimental phantom data demonstrated that the B0ReconNet enabled distortion-corrected image reconstruction from fully sampled and subsampled k-space data in real-time.

Acknowledgements

No acknowledgement found.

References

[1] Pollard JM, Wen Z, Sadagopan R, Wang J, Ibbott GS. The future of image-guided radiotherapy will be MR guided. The British journal of radiology. 2017;90(1073):20160667.

[2] Keall PJ, Barton M, Crozier S. The Australian magnetic resonance imaging–linac program. Paper presented at: Seminars in radiation oncology2014.

[3] Baldwin LN, Wachowicz K, Fallone BG. A two‐step scheme for distortion rectification of magnetic resonance images. Medical physics. 2009;36(9Part1):3917-3926.

[4] Tao S, Trzasko JD, Gunter JL, et al. Gradient nonlinearity calibration and correction for a compact, asymmetric magnetic resonance imaging gradient system. Phys Med Biol. 2017;62(2):N18-N31.

[5] Shan, Shanshan, Yang Gao, Paul ZY Liu, Brendan Whelan, Hongfu Sun, Bin Dong, Feng Liu, and David EJ Waddington. "Distortion-Corrected Image Reconstruction with Deep Learning on an MRI-Linac." arXiv preprint arXiv:2205.10993 (2022).

[6] Shan, S., Liney, G. P., Tang, F., Li, M., Wang, Y., Ma, H., ... & Crozier, S. (2020). Geometric distortion characterization and correction for the 1.0 T Australian MRI‐linac system using an inverse electromagnetic method. Medical physics, 47(3), 1126-1138.

[7] Baldwin, L.N., Wachowicz, K., Thomas, S.D., Rivest, R. and Fallone, B.G., 2007. Characterization, prediction, and correction of geometric distortion in MR images. Medical physics, 34(2), pp.388-399.

[8] Zhang, J. and Ghanem, B., 2018. ISTA-Net: Interpretable optimization-inspired deep network for image compressive sensing. In Proceedings of the IEEE conference on computer vision and pattern recognition (pp. 1828-1837).

Figures

Figure 1. Fully sampled brain data with positive and negative gradient polarities was simulated at 230Hz, 115Hz and 57Hz. Conventional FT reconstructions were compared with the proposed B0ReconNet at 230Hz. Error maps of each reconstructed image are shown at the bottom.

Figure 2. Reconstruction of simulated brain images at AF of 2 and 4. ZF, CS and B0ReconNet reconstructions were compared. Conventional FT was used to reconstruct fully sampled data. Zoomed regions (red rectangle) are shown at the bottom of each image.

Figure 3. Boxplots of (a) RMSE and (b) SSIM values of 300 testing brain images reconstructed by ZF, CS, and B0ReconNet methods at AF = 4. The minimum, first quartile (25%), median (50%), third quartile (75%) and maximum value were statistically evaluated. Red crosses denote outliers, accounting for 0.7% of total samples.

Figure 4. Grid phantom images acquired from the MRI-Linac scanner with positive (top row) and negative (bottom row) gradient polarities. Fully sampled grid phantom images were reconstructed by FT and B0ReconNet. Subsampled data with AF=4 were reconstructed using ZF, CS, and B0ReconNet, respectively.

Proc. Intl. Soc. Mag. Reson. Med. 31 (2023)
3101
DOI: https://doi.org/10.58530/2023/3101