1053

Iterative RAKI with complex-valued convolution for improved image reconstruction with limited training samples
Peter Dawood1,2, Martin Blaimer3, Felix Breuer3, Paul R. Burd4, István Homolya5,6, Peter M. Jakob1, and Johannes Oberberger2
1Department of Physics, University of Würzburg, Würzburg, Germany, 2Department of Internal Medicine I, University Hospital Würzburg, Würzburg, Germany, 3Magnetic Resonance and X-ray Imaging Department, Fraunhofer IIS, Fraunhofer Institute for Integrated Circuits IIS, Division Development Center X-Ray Technology, Würzburg, Germany, 4Institute for Theoretical Physics and Astrophysics, University of Würzburg, Würzburg, Germany, 5Brain Imaging Centre, Research Centre for Natural Sciences, Budapest, Hungary, 6Institute of Nuclear Techniques, Budapest University of Technology and Economics, Budapest, Hungary

Synopsis

Recently, the Parallel Imaging method GRAPPA has been generalized by the deep-learning method RAKI, in which Convolutional Neural Networks are used for non-linear k-space interpolation. RAKI uses scan-specific training data, however, due to its increased parameter-space, its reconstruction quality may deteriorate given a limited training-data amount. We evaluate an approach that includes augmented training-data via an initial GRAPPA k-space reconstruction, and weights refinement by iterative training. Thereby, severe residual artefacts are suppressed in RAKI, while preserving its resilience against g-factor noise enhancement in GRAPPA for standard 2D imaging at medium accelerations, for strongly varying contrast between training- and interpolation-data, too.

Introduction

In clinical routine, MRI scan-time reduction is commonly achieved by Parallel Imaging methods, typically based on uniform k-space sub-sampling and simultaneous signal reception with multiple receiver coils. The GRAPPA1 method interpolates missing k-space signals by linear-combination of adjacent, acquired signals across all channels, and can be described by a linear convolution in k-space. Recently, a more generalized method called RAKI2 was introduced. RAKI is a deep-learning method that generalizes GRAPPA with additional convolution layers, on which a non-linear activation function is applied. This enables non-linear estimation of missing signals by convolutional neural networks (CNNs). In analogy to GRAPPA, the convolution kernels in RAKI are trained using scan-specific training samples, which are obtained from auto-calibration-signals (ACS). RAKI provides superior reconstruction quality in comparison to GRAPPA, however, often requires much more ACS due to its increased number of unknown parameters. In order to overcome this limitation, an iterative k-space interpolation approach (Iterative RAKI) is proposed.

Methods

RAKI: Two major modifications were made in comparison to the original implementation2: In order to avoid that the mathematical correlation is dismissed between real-and imaginary-part of k-space data, we implemented complex-valued convolutions instead of its real-valued counterpart within the CNN3,4. Furthermore, to yield a time benefit in training, we implemented one single CNN for simultaneous multi-coil k-space interpolation, instead of assigning each coil one CNN.
Iterative RAKI: An initial GRAPPA reconstruction is performed using a small fully sampled central k-space region (8%) as original ACS to obtain augmented training data of increased size for RAKI training, and to allow for increasing the filter-size assigned to the first convolution layer in the CNN5,6 from 5x2 to 7x6 (readout RO x phase encoding PE), respectively (Fig. 1). Augmented training data is extracted from N=100 central lines of the initial GRAPPA k-space reconstruction. Subsequent iterations follow in which the CNN weights are transferred, and further optimized using N’=100 central lines from the RAKI reconstruction of the previous iteration as training data (orig. ACS re-inserted at each iteration). The learning rate η is decreased by ∆η after each iteration (initial value η0=0.05, ∆η=0.003 for R=4 and 0.004 for R=5, R: undersampling-rate). Complex ReLU7 is chosen as activation, and the mean-squared-error as cost function. Coil-images are combined using root-sum-of-squares.
In-vivo Experiments (Variable density acquisition-scheme): 2D brain imaging was acquired on healthy volunteer at 3T (Magnetom Skyra, Siemens Healthineers) using T1-weighted TSE (TR/TE=500/10 ms, FOV=220x193 mm2 (ROxPE), matrix-size= 256x224, 16 receiver-coils). Additionally, a FLAIR dataset from the fastMRI8 neuro database is considered (TSE, TR/TE=9000/181 ms, Inv.-Time 2500 ms, FOV=220x220 mm2, matrix-size 320x320, 16 receiver-coils). Both datasets were retrospectively undersampled, and 8% of total number of phase-encoding lines at k-space center were used as original ACS. Phase-constrained Iterative RAKI was also tested using the VCC-concept9, where additional virtual coils are generated from conjugate-symmetric k-space signals of actual coils. Thereby, additional image- and coil-phase information can be incorporated into the k-space reconstruction process.
In-vivo Experiments (Pre-scan calibration): To investigate the performance of Iterative RAKI on strongly varying contrast information between training– and undersampled-data5, a proton-density weighted pre-scan of size 64x64 (ROxPE) was acquired, which served as training data for GRAPPA, RAKI and Iterative RAKI. The calibrated models were then used to reconstruct a subsequently acquired, 4-fold undersampled brain-scan (T1-weighted FLASH, TR/TE=250/3.1ms, FOV=250x195 mm2, matrix-size 320x260, 16 receiver-coils). Note that as the training data is no integral part of the image scan, it is not re-inserted into reconstructed k-spaces.

Results

Using only 18 ACS lines (8%) for the T1-dataset at R=4, Iterative RAKI outperforms standard RAKI by suppressing severe residual artefacts, while preserving its g-factor noise-resilience regarding GRAPPA (Fig.2A). This is observed for the FLAIR fastMRI dataset using 26 ACS lines (8%), too (Fig.2B). The enhanced performance is also indicated by the quantitative image quality metrics NMSE, PSNR, and SSIM (Fig.2C and D). Similar results are obtained at R=5 for the FLAIR dataset (Fig.3). Phase-constrained Iterative RAKI yields a strongly enhanced noise-suppression for the T1-dataset at R=4 (Fig.4), while phase-constrained standard RAKI suffers from residual artefacts. In the pre-scan calibration, standard RAKI shows contrast-loss artefacts (Fig.5), which are not present in Iterative RAKI. Moreover, Iterative RAKI shows suppression of GRAPPA g-factor noise enhancement in this case, too.

Discussion

Iterative RAKI outperforms RAKI in standard 2D imaging given a limited training data amount at medium acceleration factors. It combines beneficial features both from GRAPPA and standard RAKI, as it suppresses g-factor noise enhancement in GRAPPA, as well as severe residual artefacts apparent in standard RAKI. The iterative approach includes training data augmentation with GRAPPA, which has been proposed2, but not demonstrated. As it is a scan-specific approach, it should prevent hallucination-artefacts, which may occur when neural networks are trained on large multi-image databases for image-reconstruction. For the T1-dataset, phase-constrained Iterative RAKI yields further enhanced reconstruction quality, however, it may be limited in its applicability, since it requires consistent k-space information to avoid residual artefacts.

Conclusion

The number and contrast of ACS is essential for standard RAKI reconstruction quality. For limited training data amount, Iterative RAKI combines beneficial features of GRAPPA and standard RAKI to yield improved reconstruction quality, for training data with strongly varying contrast information, too.

Acknowledgements

The authors thank dataSphere from University of Würzburg for informative discussions and the German Federal Ministry of Education and Research (BMBF) for funding projectline VIP+ (03VP04951).

References

[1]Griswold MA, et al. Generalized autocalibrating partially parallel acquisitions (GRAPPA). Magnetic Resonance in Medicine 2002;47(6):1202–1210.

[2] Akçakaya M, et al. Scan-specific robust artificial-neural-networks for k-space interpolation (RAKI) reconstruction: Database-free deep learning for fast imaging. Magnetic Resonance in Medicine 2019;81(1):439–453.

[3]Cole E, et al. Analysis of deep complex-valued convolutional neural networks for MRI reconstruction and phase-focused applications. Magnetic Resonance in Medicine 2021;86(2):1093–1109.

[4]Virtue P. Complex-valued Deep Learning with Applications to Magnetic Resonance Image Synthesis. Berkeley, University of California at Berkeley; Technical Report No. UCB/EECS-2019-126, 2019.

[5]Dawood P, et al. Influence of training data on RAKI reconstruction quality in standard 2D imaging. In: Proceedings of the International Society for Magnetic Resonance in Medicine; 2021.

[6]Nencka AS, et al. Split-slice training and hyperparameter tuning of RAKI networks for simultaneous multi-slice reconstruction. Magnetic Resonance in Medicine 2021;85(6):3272–3280.

[7]Trabelsi C, et al. Deep Complex Networks. In: International Conference on Learning Representations; 2018.

[8] J. Zbontar, et al. fastMRI: An open dataset and benchmarks for accelerated MRI; arXiv preprint arXiv:1811.08839, 2018.

[9] Blaimer M, et al. Virtual coil concept for improved parallel MRI employing conjugate symmetric signals. Magnetic Resonance in Medicine 2009;61(1):93–102.


Figures

Figure 1: The general principle of Iterative RAKI. In the first iteration step, RAKI is trained with augmented training data obtained from an initial GRAPPA reconstruction, which is performed using original ACS (8%) at k-space center and a kernel size 5×2 (ROxPE). The first hidden layer in RAKI is assigned a convolution filter size 6×7. The convolution weights are then further refined using subsequent, iterative training steps.

Figure 2: A) GRAPPA (left), standard RAKI (center) and Iterative RAKI (right) using 18 orig. ACS lines (8%) for the T1-dataset, and B) using 26 ACS lines (8%) for the FLAIR dataset, both at 4-fold retrospective undersampling. Error images are shown below (scaled for display). The artefacts in the posterior region in A) can be attributed to pulsatile flow. C) Normalized Mean Squared Error, NMSE (top), Structural-Similarity-Index Measure, SSIM (center) and Peak Signal to noise ratio, PSNR (bottom) metrics for images depicted in A). In D), metrics are shown for images depicted in B).

Figure 3: A) GRAPPA (left), standard RAKI (center) and Iterative RAKI (right) in comparison for reconstruction of the FLAIR dataset at R=5 using 26 original ACS lines (8%). B) Corresponding quantitative reconstruction quality measures.

Figure 4: GRAPPA in comparison with standard RAKI and Iterative RAKI combined with the Virtual-Conjugate-Coils (VCC) concept at 4-fold retrospective undersampling. For training, 18 original ACS lines were used (8%). Error images are shown below, and scaled for display. In addition, the SSIM, PSNR and NSME are shown for each reconstruction. The artefacts in the posterior region can be attributed to pulsatile flow.

Figure 5: In the pre-scan calibration experiment, GRAPPA, standard RAKI and Iterative RAKI were calibrated using a pre-scan of size 64x64 (depicted left) to reconstruct a subsequently acquired, prospectively 4-fold undersampled 2D image scan. It is worth to underline that the pre-scan was acquired at different contrast information (proton-density) than the image scan (T1). Note that the training data was not re-inserted.

Proc. Intl. Soc. Mag. Reson. Med. 30 (2022)
1053
DOI: https://doi.org/10.58530/2022/1053