1973

Deep learning-based reconstruction of highly-accelerated 3D MRI MPRAGE images
Sangtae Ahn1, Uri Wollner2, Graeme McKinnon3, Rafi Brada2, John Huston4, J. Kevin DeMarco5, Robert Y. Shih5,6, Joshua D. Trzasko4, Dan Rettmann7, Isabelle Heukensfeldt Jansen1, Christopher J. Hardy1, and Thomas K. F. Foo1
1GE Research, Niskayuna, NY, United States, 2GE Research, Herzliya, Israel, 3GE Healthcare, Waukesha, WI, United States, 4Mayo Clinic College of Medicine, Rochester, MN, United States, 5Walter Reed National Military Medical Center, Bethesda, MD, United States, 6Uniformed Services University of the Health Sciences, Bethesda, MD, United States, 7GE Healthcare, Rochester, MN, United States

Synopsis

Three-dimensional (3D) MRI can achieve higher spatial resolution and signal-to-noise ratio than 2D MRI at the expense of long scan times. Recently, deep-learning (DL) techniques have been applied to reconstruction from highly undersampled data, resulting in significant scan accelerations. To assess clinical acceptability, we evaluated DL-based reconstruction on 3D MPRAGE data, using scores from image evaluation by neuroradiologists. Our DCI-Net method with reduction factor R=10 received scores higher than or equal to those of conventional parallel imaging with R=2.1. This implies the DL method can accelerate scans by an additional factor of 5 while maintaining comparable diagnostic image quality.

Introduction

Three dimensional (3D) MRI can achieve higher spatial resolution in the slice direction and higher signal-to-noise ratio (SNR) than 2D MRI at the expense of long scan times. Compressed sensing (CS) with parallel imaging enables image reconstruction from undersampled k-space data, resulting in significant scan acceleration. However, there are limits to the degree of acceleration that CS can achieve. Recently, deep-learning (DL) techniques1-4 have gained popularity for accelerating MRI while demonstrating better image quality than CS at the same reduction factors. Although there are a number of image quality metrics such as structural similarity index measure (SSIM)5 and neural network-based metrics6, the best way to assess clinical acceptability and usefulness of a reconstruction method is based on radiologists’ evaluation of diagnostic image quality.4 In this study, we evaluate DL-based accelerated reconstruction (reduction factor R=10) on T1-weighted MPRAGE, using scores from image evaluation by board-certified neuroradiologists, compared to the standard parallel imaging protocol (R=2.1).

Methods

We evaluate three variants of DCI-Net (Densely Connected Iterative Network)3 that reconstruct images from Cartesian-undersampled multi-coil 3D k-space data. DCI-Net is an unrolled reconstruction method that consists of multiple iterative blocks, each of which includes a data-consistency unit and a convolutional unit for regularization, with dense skip-layer connections among iterations (Fig. 1). In the 2D DCI-Net, 2D convolution in the regularization unit is applied to the plane defined by the phase encoding and slice encoding directions. In the alternating 2D DCI-Net, 2D convolutions are applied, alternately, to the plane defined by the phase and slice encoding directions for 3 iterations, and then to the plane defined by the frequency and phase encoding directions for 1 iteration. In the 3D DCI-Net, 3D convolutions are applied. In the alternating 2D DCI-Net and the 3D DCI-Net, the convolution kernels were applied to 13 neighboring slices. See the caption of Figure 1 for network parameters used in this study.

The DCI-Nets were trained on T1-weighted 3D brain scan data acquired using BRAVO (GE Healthcare) with retrospective undersampling (R=10) with variable-density Poisson-disc (VD-PD) sampling patterns. For training, 133 3D MRI datasets were used, and for validation, 15 were used. As a loss function for training, we used a contrast-weighted SSIM7 extended to complex-valued images where the exponents for the luminance, contrast and structure comparison functions were 0.3, 1 and 0.3, respectively.

For testing, 3D sagittal MPRAGE data (1 mm isotropic) were acquired on the high-performance 3.0 T MAGNUS head-gradient system8 (200 mT/m and 500 T/m/s gradients). Five subjects were recruited under an IRB-approved protocol and provided written informed consent. For each subject, the MPRAGE data were retrospectively undersampled with net R=10 (VD-PD), and 3 image volumes were reconstructed using the 3 DCI-Net methods. Baseline images were reconstructed by Autocalibrating Reconstruction for Cartesian imaging (ARC) with net R=2.1. For each subject, 4 image volumes (ARC, 2D DCI-Net, alternating 2D DCI-Net and 3D DCI-Net) were randomly arranged and scored by 3 board-certified neuroradiologists who were blinded to reconstruction methods. Image scoring was based on consensus reading, using a 5-point Likert scale for 8 scoring categories: SNR, artifacts, gray/white matter contrast, resolution/sharpness, deep gray, cerebellar vermis, anterior commissure, and overall quality. For the Likert scale, 1 was poor, and 5 was excellent. The assessments of the deep gray, cerebellar vermis, and anterior commissure categories focused on scoring anatomies with fine features that were thought to be vulnerable to artifacts such as blurring.

Results

Figure 2 shows the mean scores over 5 subjects, comparing the standard ARC (R=2.1) and the three DCI-Net variants (R=10). The 2D DCI-Net received scores higher than or equal to those for the other methods including the baseline ARC. All the methods were free of artifacts and showed excellent gray/white matter contrast. Figures 3 and 4 show example images for comparison. The 2D DCI-Net showed better recovery of the cerebellar vermis (Fig. 3) and the deep gray region (Fig. 4) than the other methods.

The 2D DCI-Net was also tested in prospective image acquisitions and compared to the fully sampled and the retrospectively undersampled (Fig. 5). With an R=9.9 acceleration, the scan time was 1 min 24 s compared to 13 min 33 s for the full data acquisition, realizing a substantial time saving.

Discussion

The 2D DCI-Net (R=10) was better than or comparable to the standard ARC (R=2.1) in all scoring categories. This implies the DL method can accelerate 3D MRI scans by an additional factor of 5 compared to standard parallel imaging while maintaining comparable diagnostic image quality. A recent study on 2D knee MRI also found that readers preferred DL-accelerated images than standard clinical images.4

The 2D DCI-Net was better than or equal to the 3D DCI-Net in image quality scores probably because of fewer iterations, kernels and skip connections being used in the 3D DCI-Net due to memory limitations. Given that 3D convolutions have a potential for better performance than 2D convolutions, we may revisit the 3D DCI-Net when hardware/software advances permit the practical barriers to be avoided.

Conclusion

The 2D DCI-Net enables acceleration of 3D MPRAGE scans with R=10. The image quality scores for the 2D DCI-Net (R=10) were comparable to those for standard parallel imaging (R=2.1).

Acknowledgements

This work was supported in part by CDMRP under Grant W81XWH-16-2-0054 and by NIH under Grant U01EB024450.

References

1. Hammernik K, Klatzer T, Kobler E, et al. Learning a variational network for reconstruction of accelerated MRI data. Magn Reson Med 2018;79(6):3055-3071.

2. Schlemper J, Caballero J, Hajnal JV, et al. A deep cascade of convolutional neural networks for dynamic MR image reconstruction. IEEE Trans Med Imaging 2018;37(2):491-503.

3. Malkiel I, Ahn S, Slavens Z, et al. Densely connected iterative network for sparse MRI reconstruction. ISMRM 2018, p. 3363.

4. Recht MP, Zbontar J, Sodickson DK, et al. Using deep learning to accelerate knee MRI at 3T: Results of an interchangeability study. Am J Roentgenol. 2020;215(6):1421-1429.

5. Wang Z, Bovik AC, Sheikh HR, et al. Image quality assessment: from error visibility to structural similarity. IEEE Trans Image Process 2004;13(4):600-612.

6. Johnson J, Alahi A, Li F. Perceptual losses for real-time style transfer and super-resolution. ECCV 2016.

7. Ahn S, Menini A, McKinnon G, et al. Contrast-weighted SSIM loss function for deep learning-based undersampled MRI reconstruction. ISMRM 2020.

8. Foo TKF, Tan ET, Vermilyea ME, et al. Highly efficient head‐only magnetic field insert gradient coil for achieving simultaneous high gradient amplitude and slew rate at 3.0T (MAGNUS) for brain microstructure imaging. Magn Reson Med. 2020;83(6):2356-2369.

Figures

Figure 1. Illustration of the architecture of DCI-Net. For the 2D DCI-Net, we used 28 iterations of the regularization and data-consistency units, with 9 layers and 96 kernels per layer within each regularization unit. Up to 20 skip connections were used as input to the regularization unit. For the alternating 2D DCI-Net and the 3D DCI-Net, we used 10 iterations, 9 layers per iteration, 32 kernels per layer and up to 10 skip connections.

Figure 2. Image quality scores averaged over 5 subjects for ARC (net R=2.1) and 3 variants of DCI-Net (net R=10) in 8 scoring categories. The error bars denote the sample standard deviation.

Figure 3. Example image slices from subject D, showing the cerebellar vermis indicated by the yellow arrow, reconstructed by (A) ARC (net R=2.1), (B) 2D DCI-Net (net R=10), (C) alternating 2D DCI-Net (net R=10), and (D) 3D DCI-Net (net R=10).

Figure 4. Example image slices from subject A, showing the deep gray matter, reconstructed by (A) ARC (net R=2.1), (B) 2D DCI-Net (net R=10), (C) Alternating 2D DCI-Net (net R=10), and (D) 3D DCI-Net (net R=10).

Figure 5. Example MPRAGE images reconstructed from (A) fully sampled data, and reconstructed by the 2D DCI-Net from (B) retrospectively undersampled data (R=9.9) and (C) prospectively undersampled data (R=9.9). The scan time for full sampling was 13 min 33 s, and that for prospective undersampling was 1 min 24 s. The slices do not necessarily match. The retrospectively and prospectively undersampled images (B, C) are reasonably similar although further investigation is needed.

Proc. Intl. Soc. Mag. Reson. Med. 29 (2021)
1973