1562

Magnetic Resonance Fingerprinting GAN-Transformer: removing off-resonance artifacts
Ronal Manuel Coronado1,2, Gabriel Manuel della Maggiora1,2, Carlos Manuel Castillo-Passi1,2, Gastão Cruz 3, Sergio Manuel Uribe1,2, Cristian Manuel Tejos1,2, Claudia Prieto2,3,4, and Pablo Manuel Irarrazaval2,4
1Centro de Imagenes Biomedicas-Universidad Catolica de Chile, Santiago, Chile, 2Millennium Nucleus for Cardiovascular Magnetic Resonance, Santiago, Chile, 3School of Biomedical Engineering and Imaging Sciences, King's College London, London, United Kingdom, 4Centro de Imagenes Biomedicas- Pontificia Universidad Catolica de Chile, Santiago, Chile

Synopsis

Magnetic Resonance Fingerprinting (MRF) acquisitions with balanced Steady State Free Precession (bSSFP) and spiral trajectories are prone to off-resonance artifacts. Thus, those artifacts hinder the reconstruction of the tissue maps (T1 and T2). In this work, we propose a model based on Generative Adversarial Networks (GANs) mixed with transformer blocks to decrease these artifacts. Our method improved the NMSE for both quantitative maps T1 and T2. Heavily reducing the effects of the off-resonance in comparison to classical bSSFP-MRF.

Introduction

Magnetic Resonance Fingerprinting (MRF) has been used to simultaneously estimate T1 and T2 values using a balanced Steady-State Free Precession (bSSFP) acquisition1. bSSFP-MRF retains the spin history and achieves high SNR and scan efficiency2. However, banding artifacts produced by off-resonance effects in the bSSFP affect the quality of the tissue maps. In addition, spiral acquisition causes blurring due to off-resonance3. Here, we propose to apply a Generative Adversarial Network (GAN) mixed with the transformer blocks to correct for off-resonance effects in bSSFP-MRF sequence. The feasibility of the proposed approach was evaluated in simulations.

Method

Dataset: we generated simulations with realistic brain parameters coming from BrainWeb's dataset. We employed Flip Angles (FA) between 0º-80º after an RF inversion pulse, 1000 random Time Repetitions (TR) between 14.5-18.0 ms1, balanced gradients in each TR, and a spiral readout of 18 interleaved. The FOV was 128 mm with a resolution of 2 mm.
Model Architecture: for the generator, we used a combination of two models. First, the encoder consists of a series of 1D convolutions and max pooling, and the bottleneck consists of several residual blocks similar to Earthquake Transformer4. We used transformer non-local attention blocks. For the decoder, we employed a single unit of the Earthquake Transformer's decoder. For the discriminator we used a projection discriminator5. As the objective function, we used a relativistic GAN loss6 :

$$\begin{align*}\mathcal{L}_{D} & =\mathbb{E}_{x_{r},x}\left[\left(C\left(x_{r},x\right)-\mathbb{E}_{x_{f},x}\left[C\left(x_{f},x\right)\right]-1\right){{}^2}\right]+\\ & \quad\,\mathbb{E}_{x_{f},x}\left[\left(C\left(x_{f},x\right)-\mathbb{E}_{x_{r},x}\left[C\left(x_{r},x\right)\right]+1\right){{}^2}\right]\\\mathcal{L}_{G} & =\mathbb{E}_{x_{r},x}\left[\left(C\left(x_{r},x\right)-\mathbb{E}_{x_{f},x}\left[C\left(x_{f},x\right)\right]+1\right){{}^2}\right]+\\ & \quad\,\mathbb{E}_{x_{f},x}\left[\left(C\left(x_{f},x\right)-\mathbb{E}_{x_{r},x}\left[C\left(x_{r},x\right)\right]-1\right){{}^2}\right]+\\ & \quad\,\mathbb{E}_{x_{f},x_{r}}\Vert x_{f}-x_{r}\Vert_{1}.\end{align*}$$

where $$$x_{r}$$$ is a sample from the conditional distribution of the on-resonance signal given the off-resonance signal, $$$x_{f}$$$ is a sample from the learned conditional distribution of the on-resonance signal given the off-resonance signal, and $$$x$$$ is a sample of the off-resonance signal distribution. Finally, we solved iteratively the following problems:

$$\begin{align*}\min_{G} & \mathcal{L}_{G}\\\min_{C} & \mathcal{L}_{D}.\end{align*}$$

Dictionary Generation: a Bloch simulator was used to generate fingerprints following a range of T1, T2 and df (off-resonance) values: T1(400 to 2000 ms, every 10 ms), T2 (40 to 300 ms, every 4 ms), and df (off-resonance, -250 to 250 Hz, every 2 Hz). The echo time (TE) was constant and equal to 7.25 ms for each TR. Tissue property maps were obtained by performing the measured signal to the closest dictionary entry using the maximum dot product.

Finally, to analyze the results we used the Normalized Mean Square Error $$$\mathrm{NMSE}\left(y,\hat{y}\right)=\frac{\Vert y-\hat{y}\Vert_{2}^{2}}{\Vert y\Vert_{2}^{2}}$$$, where $$$y$$$ represents the ground truth of the property maps (T1 or T2) and $$$\hat{y}$$$ is the estimation.

Results

Figures 1 and 2 show a considerable qualitative improvement in the absolute and phase images for the different TRs. In the figure 3, we can see the off-resonance map. Note that this numerical phantom is heavily afected by off-resonance artifacts, with values raging from -100 Hz to 220 Hz. Figure 4 shows a comparison of the MRF reconstructed maps using the TR images with and without the off-resonance correction. The T1 NMSE was reduced from 110% (classical MRF) to 35% (off-resonance corrected). For T2 the NMSE was decreased from 27% to 26%.

Conclusion

A general approach based on GAN mixed with transformer blocks was proposed to correct for off-resonance distortions in bSSFP-MRF with spiral sampling. Our approach for off-resonance correction showed improved reconstructions in comparison to conventional bSSFP-MRF. Future work will validate the proposed approach in phantom and in-vivo acquisitions.

Acknowledgements

The authors gratefully acknowledge ANID for funding this research through PIA-Anillo, ACT192064, Fondecyt 1191710, the ANID –Millennium Science Initiative Program – NCN17_129, EPSRC EP/P032311/1 and EP/P001009/1.

Coronado R. received funding from ANID–PCHA/Doctorado-Nacional/2018-21181628.

References

1. Ma, D. et al, “Magnetic Resonance Fingerprinting”. Nature 495, 187–192 (2013).

2. Metha et. al, “Magnetic resonance fingerprinting: a technical review”. Magnetic Resonance in Medicine (2018).

3. Nayak and Smith, “MRI artifacts and correction strategies”. Imaging Medicine, (2010).

4. Mousavi, S. M., Ellsworth, W. L., Zhu, W., Chuang, L. Y., & Beroza, G. C. (2020). Earthquake transformer—an attentive deep-learning model for simultaneous earthquake detection and phase picking. Nature communications, 11(1), 1-12.

5. Miyato, T., & Koyama, M. (2018). cGANs with projection discriminator. arXiv preprint arXiv:1802.05637.

6. Jolicoeur-Martineau, A. (2018). The relativistic discriminator: a key element missing from standard GAN. arXiv preprint arXiv:1807.00734.

Figures

Comparison between GAN correction and classical MRF with the ground truth reconstructions for different TRs.

Phase comparison between GAN correction and classical MRF with the ground truth reconstructions for different TRs.

T1 and T2 reconstructions from TR images with and without off-resonance correction.

Off-resonance map measured in Hz.

Proc. Intl. Soc. Mag. Reson. Med. 29 (2021)
1562