3558

Physics-based network fine-tuning for robust susceptibility mapping from high-pass filtered phase
Jinwei Zhang1, Alexey Dimov2, Hang Zhang1, Chao Li1, Thanh Nguyen2, Pascal Spincemaille2, and Yi Wang2
1Cornell University, New York, NY, United States, 2Weill Cornell Medicine, New York, NY, United States

Synopsis

A network fine-tuning step based on signal physics is proposed for deep learning based quantitative susceptibility mapping using high-pass filtered phase only to susceptibility. The proposed method showed better robustness compared to the pre-trained networks without fine-tuning when the test dataset deviated from the training dataset, such as a change in voxel size or high-pass filter cutoff frequency.

Introduction

Susceptibility-Weighted Imaging (SWI) [1] is an MRI method to visualize susceptibility sources such as veins, calcifications and hemorrhage. SWI is obtained from the high-pass filter phase (HPFP) of gradient-echo (GRE) data which are sensitive to tissue susceptibility differences. In contrast, Quantitative susceptibility mapping (QSM) [2] measures tissue susceptibility quantitatively by solving a dipole inversion problem starting from unfiltered complex GRE data. Recently, [3] used deep neural networks to predict QSM from HPFP data given the existing large amount of SWI HPFP data already acquired. In this study, we show that this method suffers inferior predictions when the test data properties deviate from those of the training data. Additionally, we show that incorporating the signal physics (thehigh-pass phase filtering and the dipole convolution) into the network using fine-tuning can overcome these limitations.

Methods

MRI was performed on 30 patients with multiple sclerosis (MS) using a 3T Siemens scanner with a multi-echo 3D gradient echo (GRE) sequence. Imaging parameters included: FA=15°, FOV = 24.0 cm, TE1 = 6.3 ms, TR = 49 ms, #TE = 10, ΔTE = 4.1 ms, acquisition matrix = 260 × 320 × 48, voxel size = 0.75 × 0.75 × 3 mm3. Local tissue field was estimated using non-linear fitting across multi-echo phase data [4], followed by phase unwrapping and background field removal [5]. QSM was reconstructed using Morphology Enabled Dipole Inversion (MEDI) [6]. HPFP at echo time 20 ms was simulated from the reconstructed QSM by dipole convolution followed by k-space Gaussian high-pass filtering with cutoff frequency (FC) 5/8 of the largest in-plane matrix size (320). 20/2/8 of 30 patients were used as training/validation/test datasets to predict QSM from the simulated HPFP. MRI was also performed on 8 healthy volunteers with both single-echo (echo time = 20 ms) and multi-echo GRE using the same 3T Siemens scanner and imaging parameters. HPFP were computed from the scanner using single-echo GRE data directly. QSM was computed similar as in the patient data. This formed a second test set with prospective HPFP inputs and the corresponding QSM references.


Two 3D UNets [7] were concatenated sequentially (denoted as U2Net ) as the network architecture to predict QSM from HPFP. 3D patches with patch size 64*64*32 were extracted for training and validation. A L1 loss function and Adam optimizer [8] with learning rate 1e-3 and number of epochs 100 were used on an RTX2080Ti GPU. During test time, the pre-trained network was fine-tuned using the following high-pass filtering dipole convolution forward model on the whole 3D volume:
$$\Big{\|} \angle \Big{(}\frac{Me^{i(d*x)}}{G*(Me^{i(d*x)})}\Big{)} - f_{SWI} \Big{\|}_2^2$$
Where $$$\angle$$$ the angle of complex data, $$$G$$$ the Gaussian low pass filter with fixed FC 5/8, $$$M$$$ the magnitude image at echo time, $$$d$$$ the spatial dipole kernel, $$$x = U2Net(f_{SWI})$$$ the susceptibility map output of the network with input HPFP $$$f_{SWI}$$$. Network weights were fine-tuned using the above loss function and Adam optimizer with 1e-4 learning rate and 3 steps of gradient descent. For simulated HPFP test dataset, input HPFP with various cutoff frequencies (2/8, 3/8, 4/8, 5/8 and 6/8) or voxel sizes (0.577, 0.750, 0.938 and 1.25 mm in-plane isotropic resolution) were simulated and used as input to the networks to test their robustness against image parameter change. RMSE, HFEN and SSIM were used as quantitative metrics. For prospective HPFP test dataset, HPFP acquired from the scanner was fed into the networks directly and the output QSM was compared to multi-echo GRE QSM. Mean susceptibility values of Caudate Nucleus, Globus pallidus and Putamen were measured and compared. For all experiments, the following methods were compared: UNet, UNet with fine tuning (UNetFT), concatenated UNets (U2Net), and the proposed method U2NetFT, combining U2Net with fine tuning.

Results

Figure 1 shows the predicted QSM of one simulated test data at different FCs. At FC = 3/8, over-estimations of globus pallidus (red arrows) by UNet and U2Net were reduced after fine tuning. At FC = 4/8 and 5/8, UNet shows apparent overestimation of the globus pallidus (red arrows), which was reduced after after fine-tuning. Quantitative metrics are shown in Figure 2. Reconstructions were consistently improved after fine-tuning at all FCs tested in the experiment.

Figure 3 shows the predicted QSMs of one simulated test data at different voxel sizes. At 1.25mm, over-estimations of global pallidus (red arrows) by UNet and U2Net were reduced after fine-tuning. At 0.938mm and 0.577mm, apparent over-estimations of globus pallidus (red arrows) were showed in UNet, but were reduced after fine-tuning as well. Quantitative metrics are shown in Figure 4. Reconstructions were consistently improved after fine-tuning at all voxel sizes tested in the experiment.

Figure 5(a) shows the predicted QSMs of two prospectively acquired HPFP data. For both cases, UNet and U2Net were visually blurry compared to the reference QSMs but became sharper after fine-tuning. ROIs (indexed with red numbers in Figure 5(a) reference QSM) analysis was shown in Figure 5(b). Under-estimations were observed in both UNet and UNet FT. Over-estimation of U2Net at globus pallidus were reduced by U2Net FT.

Conclusions

Network fine-tuning using dipole convolution and high-pass filtering combined physical model improved the robustness of the pre-trained HPFP-to-QSM networks.

Acknowledgements

No acknowledgement found.

References

1.Haacke, E. Mark, et al. Magnetic Resonance in Medicine 52.3 (2004): 612-618.

2.de Rochefort, Ludovic, et al. Magnetic Resonance in Medicine 63.1 (2010): 194-206.

3. Kames, Christian, et al. Magnetic Resonance in Medicine (2021).

4. Liu, Tian, et al. Magnetic resonance in medicine 69.2 (2013): 467-476.

5. Liu, Tian, et al. NMR in Biomedicine 24.9 (2011): 1129-1136.

6. Liu, Jing, et al. Neuroimage 59.3 (2012): 2560-2568.

7. Çiçek, Özgün, et al. MICCAI. Springer, Cham, 2016.

8. Kingma, Diederik P., and Jimmy Ba. arXiv preprint arXiv:1412.6980 (2014).

Figures

Figure 1. Predicted QSM of one simulated test data at different FCs. At FC = 3/8, over-estimations of globus pallidus (red arrows) by UNet and U2Net were reduced after fine tuning. At FC = 4/8 and 5/8, UNet shows apparent overestimation of the globus pallidus (red arrows), which was reduced after after fine-tuning.

Figure 2. Quantitative metrics of simulated test dataset with different FCs. Reconstructions were consistently improved after fine-tuning at all FCs tested in the experiment.

Figure 3. Predicted QSMs of one simulated test data at different voxel sizes. At 1.25mm, over-estimations of global pallidus (red arrows) by UNet and U2Net were reduced after fine-tuning. At 0.938mm and 0.577mm, apparent over-estimations of globus pallidus (red arrows) were showed in UNet, but were reduced after fine-tuning as well.

Figure 4. Quantitative metrics of simulated test dataset with different voxel sizes. Reconstructions were consistently improved after fine-tuning at all voxel sizes tested in the experiment.

Figure 5. Predicted QSMs of two prospectively acquired HPFP data. For both cases, UNet and U2Net were visually blurry compared to the reference QSMs but became sharper after fine-tuning. ROIs (indexed with red numbers in Figure 5(a) reference QSM) analysis was shown in Figure 5(b). Under-estimations were observed in both UNet and UNet FT. Over-estimation of U2Net at globus pallidus were reduced by U2Net FT.

Proc. Intl. Soc. Mag. Reson. Med. 30 (2022)
3558
DOI: https://doi.org/10.58530/2022/3558