Omer Burak Demirel1,2, Burhaneddin Yaman1,2, Steen Moeller2, Logan Dowdle2, Luca Vizioli2, Kendrick Kay2, Essa Yacoub2, John Strupp2, Cheryl Olman2, Kâmil Uğurbil2, and Mehmet Akçakaya1,2
1Electrical and Computer Engineering, University of Minnesota, Minneapolis, MN, United States, 2Center for Magnetic Resonance Research, University of Minnesota, Minneapolis, MN, United States
Synopsis
There are significant benefits to
HCP-style fMRI acquisitions, which acquires high spatial and temporal
resolution across the whole brain in an effort to better understand the human
brain. This can be achieved through simultaneous multi-slice (SMS)/Multiband (MB)
imaging, which provides rapid whole-brain coverage using high acceleration
rates albeit with increased noise amplification. Deep learning reconstruction
techniques have recently gained substantial interest in improving accelerated
MRI. Here we utilize a physics-guided self-supervised deep learning
reconstruction on a 5-fold SMS and 2-fold in-plane accelerated whole brain 7T fMRI
acquisition to reduce the reconstruction noise without altering the subsequent
fMRI result.
INTRODUCTION
Though
functional neuroimaging has revolutionized our understanding of the human brain,
additional improvements in imaging methodology for coverage and resolution are
continuously pursued for improved neuroscientific studies. Simultaneous multi-slice
(SMS)/Multiband (MB) imaging has gained immense interest in functional neuroimaging1,
due to its ability for rapid high-resolution whole-brain coverage2. However,
high temporal and spatial resolution requirements of fMRI analysis demand
higher acceleration rates that are prone to noise amplification with
conventional reconstructions. Recently, deep learning (DL) methods have emerged
as an alternative for improved accelerated MRI3-6. However, DL
methods typically require fully-sampled data for training, and such data are not
available in most highly-accelerated fMRI acquisitions. Furthermore, the effect
of DL reconstruction on subsequent fMRI analysis is not clear. In this work, we
extend a recently proposed self-supervised DL strategy7 to SMS acquisitions, and show the resulting DL
reconstruction does not alter the analysis of HCP-style retinotopic mapping
acquisition.
METHODS
SELF-SUPERVISED DL RECONSTRUCTION FOR SMS FMRI:
We use physics-guided DL reconstruction3-6, which incorporates the forward
encoding model of the acquisition for a regularized reconstruction. The inverse
problem for regularized SMS reconstruction is given as
$$\arg \min_{\bf x_1,\cdots,x_S}=\bigg\lVert\mathbf{y}_{SMS}^{\mathbf{\Omega}}-\sum_{i=1}^{S} \mathbf{E}_{i}^{\mathbf{\Omega}}\mathbf{x}_i\bigg\rVert_{2}^{2}+\cal{R}(\mathbf{x}_1,\cdots,\mathbf{x}_S)$$
where $$$\mathbf{y}_{SMS}^{\mathbf{\Omega}}$$$ is acquired SMS
k-space, $$$\mathbf{\Omega}$$$ is sampling
pattern, S is number of slices, $$$\mathbf{E}_{i}^{\mathbf{\Omega}}$$$ is the multi-coil encoding
operator of the ith slice, $$$\mathbf{x}_i$$$ is the ith slice
image. Note the first term enforces data consistency (DC) and and $$$\cal{R}(\cdot)$$$ is a regularizer. There are various iterative
techniques that decouple the DC and regularizer into a series of sub-problems8.
Physics-guided DL reconstruction unrolls such iterative processes for a fixed
number of iterations3. Then the regularization sub-problem is
implicitly solved via neural networks, while the DC sub-problem is solved using
conventional linear methods.
The lack of reference training
data in fMRI studies inhibits conventional supervised training used for DL
methods. However, a self-supervised deep learning strategy (SSDU) that does not
require fully-sampled data for training was recently proposed, showing similar
performance to supervised learning7. SSDU7,9 divides the
acquired k-space $$$\mathbf{\Omega}$$$ into two sets, where one is used in DC units and the other
to define k-space loss. In this work, we used multi-mask SSDU9 with
3 masks, and Adam optimizer with learning rate$$$=5\times10^{-4}$$$, an $$$\ell_{1}-\ell_{2}$$$ training loss3 and 100 epochs. DC units used conjugate-gradient and the
regularizer used a ResNet7. Training was performed on 17 slab groups
from 6 subjects. Only one time-frame per subject was used, thus no temporal
correlations were exploited by DL reconstruction. Testing was performed on the
whole volume and time series of 4 different subjects. A schematic of the
implementation is shown in Figure 1.
IMAGING EXPERIMENTS:
The raw k-space data for training
and testing of the DL reconstruction was acquired at 7T (Siemens Magnetom) for retinotopic
imaging as part of the 7T Human Connectome Project10,11. For each
subject, six 5min acquisitions were obtained with standard retinotopic mapping
experiments. Specifically, the first two runs involved a rotating wedge
(RETCCW, RETCW), the second two runs involved an expanding or contracting ring
(RETEXP, RETCON), and the last two runs involved a moving bar (RETBAR1,
RETBAR2). A 5-fold SMS and 2-fold in-plane acceleration was used with a 1.6mm isotropic resolution and 1s TR.
DATA ANALYSIS:
During the testing of the DL reconstruction,
the rotating wedge (RETCCW) scan from 4 subjects, unseen by the network, was
evaluated for their tSNR (calculated by mean/standard deviation of a time
series) and functional response. The analyzePRF12 MATLAB toolbox was used for performing
population receptive field (pRF) analyses to fMRI data and quantified with Pearson's linear correlation coefficient.
Temporal stability of the reconstructed time-series was qualitatively evaluated
with the tSNR (variance normalized by the mean). No motion or distortion
correction was applied to reconstructed series.RESULTS
Fig. 2 shows reconstructed images using conventional and
self-supervised DL reconstructions. Proposed DL reconstruction visibly reduces
noise and removes residual aliasing artifacts observed in thalamus region (3rd
slice) with conventional reconstruction.
Fig. 3 depicts axial, coronal and sagittal slices of another
subject reconstructed with conventional and self-supervised DL reconstructions.
DL reconstruction substantially reduces noise in thalamus region compared to
conventional method.
Fig. 4. shows the tSNR, estimated population receptive field for the RETCCW, and the correlation
between time-series data and the pRF model for the conventional and the
self-supervised DL reconstructions. The DL reconstruction increases the tSNR in
the center of the brain compared to the conventional reconstruction. The
estimated population receptive
field (pRF) model in the occipital lope is similar for the two techniques,
reflecting that the DL reconstruction does not remove subtle temporal
effects.DISCUSSION AND CONCLUSION
In this
study, we evaluated a self-supervised physics-guided deep learning
reconstruction for highly-accelerated HCP-style fMRI. Although, the conventional
reconstruction provided sufficient baseline image quality for this particular
acquisition, DL reconstruction still reduced residual artifacts, and improved
the tSNR. The fMRI analysis led to similar results between two techniques,
showing that DL reconstruction did not alter the temporal effects or functional
spatial precision. Following this preliminary study to establish the feasibility
of DL methods for accelerated fMRI, further investigations at higher
acceleration rates are warranted to harness the full potential of the proposed DL
reconstruction.Acknowledgements
Grant
support: NIH, Grant numbers: P30NS076408, R01HL153146, U01EB025144,
P41EB027061; NSF, Grant number: CAREER CCF-1651825.References
1. Uğurbil, Kamil, et al. "Pushing spatial and temporal resolution for functional and diffusion MRI in the Human Connectome Project." NeuroImage 80 (2013): 80-104.
2. Moeller, Steen, et al. "Multiband multislice GE‐EPI at 7 tesla, with 16‐fold acceleration using partial parallel imaging with application to high spatial and temporal whole‐brain fMRI." Magnetic Resonance in Medicine 63.5 (2010): 1144-1153.
3. Knoll, Florian, et al. "Deep-learning methods for parallel magnetic resonance imaging reconstruction: A survey of the current approaches, trends, and issues." IEEE Signal Processing Magazine 37.1 (2020): 128-140.
4. Hammernik, Kerstin, et al. "Learning a variational network for reconstruction of accelerated MRI data." Magnetic Resonance in Medicine 79.6 (2018): 3055-3071.
5. Schlemper, Jo, et al. "A deep cascade of convolutional neural networks for dynamic MR image reconstruction." IEEE Transactions on Medical Imaging 37.2 (2017): 491-503.
6. Aggarwal, Hemant K., Merry P. Mani, and Mathews Jacob. "MoDL: Model-based deep learning architecture for inverse problems." IEEE Transactions on Medical Imaging 38.2 (2018): 394-405.
7. Yaman, Burhaneddin, et al. "Self‐supervised learning of physics‐guided reconstruction neural networks without fully sampled reference data." Magnetic Resonance in Medicine 84.6 (2020): 3172-3191.
8. Fessler, Jeffrey A. "Optimization methods for MR image reconstruction (long version)." arXiv preprint arXiv:1903.03510 (2019).
9. Yaman, Burhaneddin, et al. "Improved Supervised Training of Physics-Guided Deep Learning Image Reconstruction with Multi-Masking." arXiv preprint arXiv:2010.13868 (2020).
10. Benson, Noah C., et al. "The Human Connectome Project 7 Tesla retinotopy dataset: Description and population receptive field analysis." Journal of vision 18.13 (2018): 23-23.
11. Glasser, Matthew F., et al. "The minimal preprocessing pipelines for the Human Connectome Project." Neuroimage 80 (2013): 105-124.
12. Kay, Kendrick N., et al. "Compressive spatial summation in human visual cortex." Journal of Neurophysiology 110.2 (2013): 481-494.