Ronal Manuel Coronado1,2, Gabriel Manuel della Maggiora1,2, Carlos Manuel Castillo-Passi1,2, Gastão Cruz 3, Sergio Manuel Uribe1,2, Cristian Manuel Tejos1,2, Claudia Prieto2,3,4, and Pablo Manuel Irarrazaval2,4
1Centro de Imagenes Biomedicas-Universidad Catolica de Chile, Santiago, Chile, 2Millennium Nucleus for Cardiovascular Magnetic Resonance, Santiago, Chile, 3School of Biomedical Engineering and Imaging Sciences, King's College London, London, United Kingdom, 4Centro de Imagenes Biomedicas- Pontificia Universidad Catolica de Chile, Santiago, Chile
Synopsis
Magnetic Resonance Fingerprinting (MRF) acquisitions with
balanced Steady State Free Precession (bSSFP) and spiral trajectories are prone to off-resonance artifacts. Thus, those artifacts hinder the reconstruction
of the tissue maps (T1 and T2). In this work, we propose a model based on Generative Adversarial Networks (GANs) mixed with transformer blocks to decrease these artifacts. Our method improved the NMSE for both quantitative maps T1 and T2. Heavily reducing the effects of the off-resonance in comparison to classical bSSFP-MRF.
Introduction
Magnetic Resonance Fingerprinting (MRF) has been used
to simultaneously estimate T1 and T2 values using a balanced Steady-State Free
Precession (bSSFP) acquisition1. bSSFP-MRF retains the spin history
and achieves high SNR and scan efficiency2. However, banding artifacts
produced by off-resonance effects in the bSSFP affect the quality of the tissue
maps. In addition, spiral acquisition causes blurring due to off-resonance3.
Here, we propose to apply a Generative Adversarial Network (GAN) mixed with the transformer blocks to correct for off-resonance effects in bSSFP-MRF sequence. The feasibility of the proposed approach was evaluated in
simulations.Method
Dataset: we generated simulations with realistic brain parameters coming from BrainWeb's dataset.
We employed Flip Angles (FA) between 0º-80º after an RF inversion pulse, 1000
random Time Repetitions (TR) between 14.5-18.0 ms1, balanced
gradients in each TR, and a spiral readout of 18 interleaved. The FOV was 128 mm
with a resolution of 2 mm.
Model Architecture: for the generator, we used a combination of two
models. First, the encoder consists of a series of 1D convolutions and max pooling,
and the bottleneck consists of several residual blocks similar to Earthquake
Transformer4. We used transformer non-local attention
blocks. For the decoder, we employed a single unit of the Earthquake Transformer's decoder. For the discriminator we used a projection discriminator5. As the objective function, we used a relativistic GAN loss6 :
$$\begin{align*}\mathcal{L}_{D} & =\mathbb{E}_{x_{r},x}\left[\left(C\left(x_{r},x\right)-\mathbb{E}_{x_{f},x}\left[C\left(x_{f},x\right)\right]-1\right){{}^2}\right]+\\ & \quad\,\mathbb{E}_{x_{f},x}\left[\left(C\left(x_{f},x\right)-\mathbb{E}_{x_{r},x}\left[C\left(x_{r},x\right)\right]+1\right){{}^2}\right]\\\mathcal{L}_{G} & =\mathbb{E}_{x_{r},x}\left[\left(C\left(x_{r},x\right)-\mathbb{E}_{x_{f},x}\left[C\left(x_{f},x\right)\right]+1\right){{}^2}\right]+\\ & \quad\,\mathbb{E}_{x_{f},x}\left[\left(C\left(x_{f},x\right)-\mathbb{E}_{x_{r},x}\left[C\left(x_{r},x\right)\right]-1\right){{}^2}\right]+\\ & \quad\,\mathbb{E}_{x_{f},x_{r}}\Vert x_{f}-x_{r}\Vert_{1}.\end{align*}$$
where $$$x_{r}$$$ is a sample from the conditional distribution of the on-resonance signal given the off-resonance signal, $$$x_{f}$$$ is a sample from the learned conditional distribution of the on-resonance signal given the off-resonance signal, and $$$x$$$ is a sample of the off-resonance signal distribution. Finally, we solved iteratively the following problems:
$$\begin{align*}\min_{G} & \mathcal{L}_{G}\\\min_{C} & \mathcal{L}_{D}.\end{align*}$$
Dictionary Generation: a Bloch
simulator was used to generate fingerprints
following a range of T1, T2 and df (off-resonance) values: T1(400 to 2000 ms,
every 10 ms), T2 (40 to 300 ms, every 4 ms), and df (off-resonance, -250 to 250
Hz, every 2 Hz). The echo time (TE) was constant and equal to 7.25 ms for each
TR. Tissue property maps were obtained by performing the measured signal to the closest
dictionary entry using the maximum dot product.
Finally, to analyze the results we used the Normalized Mean Square Error $$$\mathrm{NMSE}\left(y,\hat{y}\right)=\frac{\Vert y-\hat{y}\Vert_{2}^{2}}{\Vert y\Vert_{2}^{2}}$$$, where $$$y$$$ represents the ground truth of the property maps (T1 or T2) and $$$\hat{y}$$$ is the estimation.
Results
Figures 1 and 2 show a considerable qualitative improvement in the absolute and phase images for the different TRs. In the figure 3, we can see the off-resonance map. Note that this numerical phantom is heavily afected by off-resonance artifacts, with values raging from -100 Hz to 220 Hz. Figure 4 shows a comparison of the MRF reconstructed maps using the TR images with and without the off-resonance correction. The T1 NMSE was reduced from 110% (classical MRF) to 35% (off-resonance corrected). For T2 the NMSE was decreased from 27% to 26%.Conclusion
A general approach based on GAN mixed with transformer blocks was proposed to correct
for off-resonance distortions in bSSFP-MRF with spiral sampling. Our approach for off-resonance correction showed
improved reconstructions in comparison to conventional bSSFP-MRF. Future work will validate the proposed approach in phantom and in-vivo acquisitions. Acknowledgements
The authors gratefully acknowledge ANID for funding
this research through PIA-Anillo, ACT192064, Fondecyt 1191710, the ANID –Millennium
Science Initiative Program – NCN17_129, EPSRC EP/P032311/1 and EP/P001009/1.
Coronado R. received funding from
ANID–PCHA/Doctorado-Nacional/2018-21181628.
References
1. Ma, D. et al, “Magnetic Resonance
Fingerprinting”. Nature 495, 187–192
(2013).
2. Metha et. al,
“Magnetic resonance fingerprinting: a technical review”. Magnetic Resonance in
Medicine (2018).
3. Nayak and Smith, “MRI artifacts and correction
strategies”. Imaging Medicine, (2010).
4. Mousavi, S. M., Ellsworth, W. L., Zhu, W., Chuang, L. Y., & Beroza, G. C. (2020). Earthquake transformer—an attentive deep-learning model for simultaneous earthquake detection and phase picking. Nature communications, 11(1), 1-12.
5. Miyato, T., & Koyama, M. (2018). cGANs with projection discriminator. arXiv preprint arXiv:1802.05637.
6. Jolicoeur-Martineau, A. (2018). The relativistic discriminator: a key element missing from standard GAN. arXiv preprint arXiv:1807.00734.