Peter Dawood1,2, Martin Blaimer3, Felix Breuer3, Paul R. Burd4, István Homolya5,6, Peter M. Jakob1, and Johannes Oberberger2
1Department of Physics, University of Würzburg, Würzburg, Germany, 2Department of Internal Medicine I, University Hospital Würzburg, Würzburg, Germany, 3Magnetic Resonance and X-ray Imaging Department, Fraunhofer IIS, Fraunhofer Institute for Integrated Circuits IIS, Division Development Center X-Ray Technology, Würzburg, Germany, 4Institute for Theoretical Physics and Astrophysics, University of Würzburg, Würzburg, Germany, 5Brain Imaging Centre, Research Centre for Natural Sciences, Budapest, Hungary, 6Institute of Nuclear Techniques, Budapest University of Technology and Economics, Budapest, Hungary
Synopsis
Recently,
the
Parallel Imaging method GRAPPA has been generalized
by the deep-learning method RAKI, in which Convolutional Neural
Networks are used for non-linear k-space interpolation. RAKI uses
scan-specific training data, however,
due
to its increased parameter-space,
its reconstruction quality may deteriorate given a
limited training-data amount.
We
evaluate an
approach that includes augmented training-data via an initial GRAPPA k-space reconstruction, and weights
refinement by iterative training. Thereby, severe residual artefacts
are suppressed
in RAKI, while preserving its resilience
against g-factor noise enhancement in GRAPPA for
standard 2D imaging
at
medium accelerations, for
strongly varying contrast between training- and interpolation-data,
too.
Introduction
In
clinical routine, MRI scan-time reduction is commonly
achieved
by Parallel Imaging methods, typically
based
on uniform k-space sub-sampling and simultaneous signal reception
with multiple receiver coils. The GRAPPA1
method interpolates missing k-space signals by linear-combination of
adjacent, acquired signals across all channels, and can be described
by a linear convolution in k-space. Recently, a more generalized
method called RAKI2
was introduced. RAKI is a deep-learning method that generalizes
GRAPPA with additional convolution layers, on which a non-linear
activation function is applied. This enables non-linear estimation of
missing signals by convolutional neural networks (CNNs).
In analogy to GRAPPA, the convolution kernels in RAKI are trained
using scan-specific training samples, which are obtained
from auto-calibration-signals (ACS). RAKI provides superior
reconstruction quality in comparison to GRAPPA, however, often
requires
much
more
ACS
due
to its increased number of unknown parameters.
In
order to
overcome this
limitation,
an iterative k-space interpolation approach (Iterative
RAKI)
is proposed.Methods
RAKI:
Two
major modifications were made
in comparison to the original implementation2:
In order to avoid that the mathematical correlation is
dismissed
between real-and imaginary-part of k-space data, we implemented
complex-valued convolutions instead
of its real-valued counterpart
within the CNN3,4.
Furthermore,
to yield a time benefit in training, we implemented one single CNN
for simultaneous multi-coil k-space interpolation, instead of
assigning each coil one CNN.
Iterative
RAKI:
An initial GRAPPA reconstruction is performed using a
small
fully sampled central k-space region (8%)
as original ACS to obtain augmented
training
data
of increased size for RAKI training, and to allow for increasing the
filter-size assigned
to
the first convolution
layer in the CNN5,6
from
5x2
to 7x6
(readout RO x phase encoding PE),
respectively
(Fig. 1). Augmented
training
data
is extracted from N=100 central
lines of the initial GRAPPA k-space reconstruction. Subsequent
iterations follow in which the CNN weights are transferred, and
further optimized using N’=100 central lines from the RAKI
reconstruction of the previous iteration as training
data
(orig. ACS re-inserted at each iteration). The learning rate η
is decreased by ∆η
after each iteration (initial value η0=0.05,
∆η=0.003
for R=4 and
0.004
for R=5, R: undersampling-rate). Complex ReLU7
is
chosen as activation, and
the mean-squared-error as cost function. Coil-images
are combined using root-sum-of-squares.
In-vivo
Experiments (Variable
density acquisition-scheme):
2D brain imaging was
acquired on
healthy volunteer at 3T
(Magnetom Skyra, Siemens Healthineers) using T1-weighted
TSE (TR/TE=500/10
ms, FOV=220x193
mm2
(ROxPE),
matrix-size=
256x224,
16
receiver-coils).
Additionally, a FLAIR dataset
from the fastMRI8
neuro database is considered (TSE,
TR/TE=9000/181
ms, Inv.-Time
2500 ms, FOV=220x220
mm2,
matrix-size 320x320,
16 receiver-coils).
Both datasets were
retrospectively undersampled, and 8% of total number of
phase-encoding
lines at k-space center were used as original ACS.
Phase-constrained
Iterative RAKI was also
tested
using
the
VCC-concept9,
where additional virtual coils are generated from
conjugate-symmetric k-space signals of
actual coils. Thereby, additional
image- and coil-phase information can
be
incorporated into
the
k-space
reconstruction process.
In-vivo
Experiments
(Pre-scan
calibration):
To
investigate the performance of Iterative RAKI on strongly varying
contrast information between training– and undersampled-data5,
a
proton-density weighted
pre-scan of size 64x64 (ROxPE) was acquired, which served as training
data for GRAPPA, RAKI and Iterative RAKI. The calibrated models were
then used to reconstruct a subsequently acquired, 4-fold undersampled
brain-scan (T1-weighted
FLASH,
TR/TE=250/3.1ms,
FOV=250x195
mm2,
matrix-size 320x260,
16
receiver-coils).
Note
that as the
training data is no integral part of the image
scan, it is not re-inserted into reconstructed k-spaces.Results
Using
only 18 ACS
lines (8%)
for the T1-dataset at
R=4,
Iterative RAKI outperforms
standard RAKI by suppressing severe
residual artefacts, while preserving its g-factor
noise-resilience
regarding GRAPPA (Fig.2A).
This
is observed for the FLAIR fastMRI dataset using 26 ACS lines (8%), too
(Fig.2B).
The enhanced performance is also indicated
by the
quantitative image
quality
metrics NMSE, PSNR, and
SSIM
(Fig.2C
and D).
Similar
results are obtained
at
R=5 for the FLAIR dataset (Fig.3).
Phase-constrained
Iterative
RAKI yields a
strongly enhanced noise-suppression
for
the T1-dataset
at
R=4 (Fig.4),
while
phase-constrained
standard
RAKI suffers from residual artefacts.
In
the pre-scan calibration, standard RAKI shows contrast-loss artefacts
(Fig.5),
which are not present in Iterative RAKI. Moreover,
Iterative
RAKI
shows
suppression of
GRAPPA g-factor noise enhancement in
this case,
too. Discussion
Iterative RAKI outperforms
RAKI in standard 2D imaging given a limited training data amount at
medium acceleration factors. It combines beneficial
features both from
GRAPPA and standard
RAKI, as it suppresses g-factor
noise enhancement in
GRAPPA, as well as severe residual artefacts apparent
in standard RAKI. The
iterative approach includes training data augmentation with GRAPPA,
which has been proposed2,
but not demonstrated.
As
it is a scan-specific approach, it should
prevent hallucination-artefacts, which may occur when neural networks
are trained on large multi-image databases for image-reconstruction.
For
the T1-dataset, phase-constrained
Iterative RAKI yields
further
enhanced reconstruction
quality,
however,
it may be
limited in its applicability, since it requires consistent k-space
information to avoid residual artefacts. Conclusion
The
number
and contrast of ACS is essential for standard RAKI reconstruction
quality. For
limited training data amount, Iterative RAKI combines beneficial
features of GRAPPA and standard RAKI to yield improved
reconstruction quality, for
training data with strongly varying contrast information, too. Acknowledgements
The
authors thank dataSphere
from
University of Würzburg for informative discussions and
the German Federal Ministry of Education and Research (BMBF) for
funding projectline VIP+ (03VP04951). References
[1]Griswold
MA, et al. Generalized autocalibrating partially parallel
acquisitions (GRAPPA). Magnetic Resonance in Medicine
2002;47(6):1202–1210.
[2]
Akçakaya M, et al. Scan-specific robust artificial-neural-networks
for k-space interpolation (RAKI) reconstruction: Database-free deep
learning for fast imaging. Magnetic Resonance in Medicine
2019;81(1):439–453.
[3]Cole
E, et
al.
Analysis of deep complex-valued convolutional neural networks for MRI
reconstruction
and phase-focused applications. Magnetic Resonance in Medicine
2021;86(2):1093–1109.
[4]Virtue
P. Complex-valued Deep Learning with Applications to Magnetic
Resonance Image Synthesis. Berkeley, University of California at
Berkeley; Technical Report No. UCB/EECS-2019-126, 2019.
[5]Dawood
P, et
al.
Influence of training data on RAKI reconstruction quality in standard
2D imaging. In: Proceedings of the International Society for Magnetic
Resonance in Medicine; 2021.
[6]Nencka
AS, et al. Split-slice training and hyperparameter tuning of RAKI
networks for simultaneous multi-slice reconstruction. Magnetic
Resonance in Medicine 2021;85(6):3272–3280.
[7]Trabelsi
C, et al. Deep Complex Networks. In: International Conference on
Learning Representations; 2018.
[8]
J.
Zbontar, et al. fastMRI: An open dataset and benchmarks for
accelerated MRI; arXiv preprint arXiv:1811.08839, 2018.
[9]
Blaimer M, et
al.
Virtual coil concept for improved parallel MRI employing conjugate
symmetric signals. Magnetic Resonance in Medicine 2009;61(1):93–102.