0950

VarNet-based Simultaneous Multislice Reconstruction for Low Noise Amplification and Flexible Calibration
Lifeng Mei1, Celia.M. Dong2, Sixing Liu1, Shoujin Huang1, and Mengye Lyu1
1College of Health Science and Environmental Engineering, Shenzhen Technology University, Shenzhen, China, 2University Research Facility in Behavioral and Systems Neuroscience, The Hong Kong Polytechnic University, Hong Kong, China

Synopsis

Keywords: Image Reconstruction, Parallel Imaging

In this study, we combine the readout-concatenation framework with VarNet based deep learning method to achieve SMS reconstruction of low noise amplification. It can flexibly handle arbitrary slice aliasing patterns with in-plane acceleration. Moreover, the modified network architecture allows coil calibration using a prescan of different contrasts, which is preferred in many scenarios.

Introduction

Simultaneous multislice imaging (SMS) has rapidly developed into a major imaging acceleration technique. In addition to traditional SENSE1, GRAPPA2 and Slice-GRAPPA3 (SG) reconstruction methods, deep learning-based methods may also be adapted to SMS image reconstruction. Traditional reconstruction methods may suffer from high noise amplification at high acceleration factors, whereas many deep learning methods are not flexible. For example, vanilla VarNet4 requires coil sensitivity calibration internally from the same scan, while some other methods require ESPIRIT7 calibration in advance, which may be suboptimal and inconvenient.
In this study, we combine the readout-concatenation framework with VarNet based deep learning method to achieve SMS reconstruction of low noise amplification. It can flexibly handle arbitrary slice aliasing patterns with in-plane acceleration. Moreover, the modified network architecture allows coil calibration using a prescan of different contrasts, which is preferred in many scenarios.

Methods

VarNet-based SMS reconstruction
The proposed SMS reconstruction method is based on the VarNet network and readout-concatenation9 framework as shown in Fig. 1. The internal U-structure module can be a simple U-Net (denoted as VarNet) or more advanced NAFNet5 structure (denoted as NAF-VarNet).
Unlike the original VarNet method, we separately feed the SMS data and the autocalibration signal (ACS) data to the network. This enables external calibration using ACS data from a prescan to estimate coil sensitivity, which is desirable for faster clinical examination and in fact the routine practice for fMRI and DWI applications.
Note that prior information of the scan, such as the multiband (MB) factor, FOV shift, and intra-plane acceleration (R) factor, can be optionally used in the cross-attention module (CA block in Figure 1). We denoted this improved model as NAF-VarNet-Plus.
Experiments on fastMRI
We synthesized SMS data from fastMRI8 multicoil brain data. The training and validation sets were as officially divided. We first used the CAIPIRINHA6 method to introduce a FOV shift for each slice that was simultaneously excited, setting the shift to be the inverse of the MB factor. Then the data were summed along slice direction and reorganized to form readout-concatenated data. The calibration region size was set to 30 x 30.
Training details
All VarNet-based methods were trained with mixed MB factors ranging from 2 to 5 randomly in combination with in-plane acceleration of 1, 4, and 8. Due to the GPU memory limit, we set the number of VarNet cascade modules to 3, and reduced the number of NAFNet blocks to 2 per layer for fair comparison. Network weights were iteratively optimized by minimizing the SSIM loss and Charbonnier loss. SSIM is a structural similarity index, while Charbonnier loss is more robust than L1 loss and can better handle outliers.
Experiments on low-field data with external calibration
To investigate the feasibility of external coil calibration using prescan, we acquired FLAIR data (matrix size=256×198, FOV=240×240, TR/TE/TI=7500/98/1655, ETL=11) and T2-weighted data (matrix size=256×195, FOV=240×240, TR/TE =5500/122, ETL=13) on a 0.3T MRI scanner (Oper-0.3, Ningbo Xingaoyi) from 150 human subjects. SMS acceleration was introduced retrospectively as in the fastMRI experiments to the FLAIR data and the T2w data were used for coil sensitivity calibration. We compared three VarNet models: one trained solely on fastMRI (denoted as NAF-VarNet-fastMRI), one solely trained on the low-field data (denoted as NAF-VarNet-LF), and one finetuned on the low-field data after fastMRI pretraining (denoted as NAF-VarNet-finetune).

Results

As visually plotted in Figure 2 and quantitatively measured in Figure 3, the proposed VarNet-based methods vastly reduced the noise amplification compared to GRAPPA. Particularly, NAF-VarNet and NAF-VarNet-Plus performed better than the baseline VarNet (simple UNet-based). Figure 4 shows the reconstructed images of NAF-VarNet-Plus and GRAPPA under different multiband (MB) and in-plane acceleration (R) factors, where substantial improvement by NAF-VarNet-Plus can be observed. Figure 5 demonstrated the feasibility of using external ACS data of T2 weighting to reconstruct FLAIR SMS data, for which fine-tuning was found necessary because the fastMRI brain dataset did not include such multicontrast data.

Discussion and Conclusion

In this abstract, we present a VarNet-based SMS reconstruction method that is flexible to combine with in-plane acceleration. Experimental results show that this method greatly improves image quality compared with traditional parallel imaging. It not only performed robustly across datasets but also enables external calibration using prescans. Nonetheless, there are some limitations of the current study. First, we have not evaluated the methods on prospectively accelerated data. Second, the large image size of readout concatenated data causes very high GPU memory usage. Last, we did not compare it with alternative approaches using ESPIRiT as the coil calibration method. However, as has been previously studied4, our end-to-end approach is more convenient and potentially has higher limits.

Acknowledgements

This study is supported in part by Natural Science Foundation of Top Talent of Shenzhen Technology University (Grants No. 20200208 to Lyu, Mengye) and the National Natural Science Foundation of China (Grant No. 62101348 to Lyu, Mengye)

References

1. Pruessmann, Klaas P., et al. "SENSE: sensitivity encoding for fast MRI." Magnetic Resonance in Medicine: An Official Journal of the International Society for Magnetic Resonance in Medicine 42.5 (1999): 952-962.

2. Griswold, Mark A., et al. "Generalized autocalibrating partially parallel acquisitions (GRAPPA)." Magnetic Resonance in Medicine: An Official Journal of the International Society for Magnetic Resonance in Medicine 47.6 (2002): 1202-1210.

3. Setsompop, Kawin, et al. “Blipped‐controlled aliasing in parallel imaging for simultaneous multislice echo planar imaging with reduced g‐factor penalty.” Magnetic resonance in medicine 67.5 (2012): 1210-1224.

4. Sriram, Anuroop, et al. "End-to-end variational networks for accelerated MRI reconstruction." International Conference on Medical Image Computing and Computer-Assisted Intervention. Springer, Cham, 2020.

5. Chen, Liangyu, et al. "Simple baselines for image restoration." arXiv preprint arXiv:2204.04676 (2022). 6. Breuer, Felix A., et al. "Controlled aliasing in parallel imaging results in higher acceleration (CAIPIRINHA) for multi‐slice imaging." Magnetic Resonance in Medicine: An Official Journal of the International Society for Magnetic Resonance in Medicine 53.3 (2005): 684-691.

7. Uecker, Martin, et al. "ESPIRiT—an eigenvalue approach to autocalibrating parallel MRI: where SENSE meets GRAPPA." Magnetic resonance in medicine 71.3 (2014): 990-1001.

8. Zbontar, J., Knoll, F., Sriram, A., Murrell, T., Huang, Z., Muckley, M. J., ... & Lui, Y. W. (2018). fastMRI: An open dataset and benchmarks for accelerated MRI. arXiv preprint arXiv:1811.08839.

9. Moeller, Steen, et al. "Multiband multislice GE‐EPI at 7 tesla, with 16‐fold acceleration using partial parallel imaging with application to high spatial and temporal whole‐brain fMRI." Magnetic resonance in medicine 63.5 (2010): 1144-1153.

Figures

Figure 1. The schematic illustration of our VarNet-based SMS reconstruction approach. Our model takes as input the multi-coil k-space readout-concatenated data as well as its ACS data. Firstly, we apply a U-Net to estimate coil sensitivity. Next, we implement unrolled optimization through a series of cascaded modules. Before the output of unrolled block, the data consistency module is used. Finally, the IFT is applied to the multi-coil k-space reconstruction image output by multiple cascaded modules, and then the sum of Root and Square reduction is performed for coil combination.

Figure 2. Representative SMS image reconstruction results at MB=4 and R=1. The right half of each image is the brightness enhanced (×5) error map. The two values at the top left of each row of images are the average PSNR/SSIM with regard to the Ground Truth (GT) images. The proposed VarNet-based reconstruction reduced the noise compared to the traditional GRAPPA algorithm reconstruction. In contrast to VarNet, NAF-VarNet with channel attention suppressed more residual artifacts, and NAF-VarNet-Plus further optimized the reconstruction quality.

Figure 3. Quantitative comparison of reconstruction performance of GRAPPA, VarNet, NAF-VarNet and NAF-VarNet-Plus under different in-plane acceleration (1, 4, and 8) and MB factors (2, 3, 4, and 5). At low MB factor = 2 and 1-fold in-plane acceleration, GRAPPA was comparable to the VarNet-based methods. With the increase of MB factor, the reconstruction quality of the VarNet-based method was increasingly superior.

Figure 4. The comparison of GRAPPA and NAF-VarNet-Plus (the best-performing VarNet-based model) reconstructions under different combination of multiband (MB) and in-plane acceleration (R) factors. The right half of each image is the brightness enhanced (×5) error map. The two values at the top left of images are the PSNR/SSIM values.

Figure 5. The results and error maps of GRAPPA and VarNet-based reconstruction at MB=2 and R=2, which were performed on low-field FLAIR data. (a) shows the results of using the ACS from FLAIR itself to estimate the coil sensitivity (internal calibration), and (b) shows the results of using the ACS from T2w data to estimate the coil sensitivity (external calibration). Note that if the coil sensitivity was from T2w data, NAF-VarNet-fastMRI model failed to reconstruct images unless retrained or finetuned. This was expected since the training in fastMRI only used internal calibration.

Proc. Intl. Soc. Mag. Reson. Med. 31 (2023)
0950
DOI: https://doi.org/10.58530/2023/0950