4168

Successful generalization for data with higher or lower resolution than training data resolution in deep learning powered QSM reconstruction
Sooyeon Ji1, Juhyung Park1, Hyeong-Geol Shin2,3, Joonhyeok Yoon1, Minjun Kim1, and Jongho Lee1
1Department of Electrical Computer Engineering, Seoul National University, Seoul, Korea, Republic of, 2Department of Radiology, Johns Hopkins University School of Medicine, Baltimore, MD, United States, 3F.M. Kirby Research Center for Functional Brain Imaging, Kennedy Krieger Institute, Baltimore, MD, United States

Synopsis

Keywords: Susceptibility, Data Processing

A pipeline to reconstruct multiple resolution QSM data using a QSM network trained at a single resolution is proposed. The local field map is re-sampled multiple times in different spatial locations, and the re-sampled local field maps are used to reconstruct QSM maps at training data resolution. The reconstructed maps are then combined, and corrected for using a procedure named “dipole compensation”. When compared to two scenarios to reconstruct different resolution data using network trained at a single resolution, the proposed pipeline demonstrated the best performance both qualitatively and quantitatively.

Introduction

Deep learning algorithms for QSM have demonstrated great potentials.1–5 However, it was reported that the deep learning methods fail to reconstruct data with resolution different from that of the training resolution.6 In this work, we propose a pipeline to reconstruct multiple resolution QSM data using QSMnet trained at a single resolution.

Methods

The proposed pipeline consists of four steps. Overview of the proposed method is displayed in Figure 1 for the case where input data is at a higher resolution (resolinput = 0.5 mm3) compared to that of the network training resolution (resoltrain = 1.0 mm3). While the diagrams are represented in 1D for simplification, extension to 3D is straightforward.
[Step 1: re-sampling of local field map] First, the local field maps are re-sampled to the training resolution at multiple spatial locations (Figure 1b). This is analogous to multiplying comb functions with different shifts, which results in k-space aliasing with different linear phase for each case (red and blue cases in Figure 1b).
[Step 2: network inference] The re-sampled field maps can be input into the network. The network performs a dipole de-convolution in the image space; and a dipole division in the k-space, which is a pointwise operation (Figure 1c).
[Step 3: assembling] By assembling QSM maps of the red and blue sampling cases, an erroneous QSM can be reconstructed (Figure 1d). Because network inference is a pointwise division in the k-space, the resulting erroneous QSM is the k-space of the original local field map ($$$L(k_{x})$$$) divided by the replicated dipole kernel of 1.0 mm3 resolution ($$$D_{1.0 iso}(k_{x})$$$).
[Step 4: dipole compensation] The k-space of the desired QSM is $$$L(k_{x})$$$ divided by the dipole kernel of 0.5 mm3 resolution ($$$D_{0.5 iso}(k_{x})$$$). Because $$$D_{1.0 iso}(k_{x})$$$ and $$$D_{0.5 iso}(k_{x})$$$ are same at the center, this difference can be compensated by multiplying $$$D_{1.0 iso}(k_{x})/D_{0.5 iso}(k_{x})$$$ at the edge of the k-space. We call this procedure the dipole compensation (Figure 1e).
The method can be extended to non-integer resolution difference case by viewing the re-sampling of local field map as image shift and re-sampling (Figure 2). In the red sampling case, the local field map is directly undersampled, resulting in k-space aliasing.
$$L_1(k_x)=\frac{L(k_x)+L(k_x+M_{train})}{N}$$
Where $$$L_{1}(k_{x})$$$ is the k-space of the undersampled local field map and Mtrain is the matrix size of the data re-sampled to training resolution. The blue undersampling case can be seen as a combination of shifting and undersampling. Shift in image space is multiplying linear phase in k-space; Assuming sub-voxel shift in the training resolution ($$${n\over N}\times resol_{train}$$$, where n = 0,1, … N-1), each line of k-space is multiplied by a linear phase $$$\phi(k_x)=exp({i2\pi nk_x \over N \times M_{train}})$$$ before being aliased.
$$L_n(k_x)=\frac{L(k_x)\times{exp}(\frac{i2{\pi}nk_x}{N\times{M_{train}}})+L(k_x+M_{train})\times{exp}(\frac{i2{\pi}n(k_x+M_{train}}{N\times{M_{train}}})}{N}$$
After network inference, QSM from the blue sampling case is shifted back to the original position by multiplying an inverse linear phase $$$\phi(k_x)=exp({-i2\pi nk_x \over N \times M_{train}})$$$ in k-space.
$$QSM_n(k_x)=L_n(k_x)\times\frac{-i2{\pi}nk_x}{N\times{M_{train}}}=\frac{L(k_x)+L(k_x+M_{train}){\times}exp(\frac{i2{\pi}n}{N})}{N{\times}D_{resol_{train}}(k_x)}$$
Therefore, the aliased k-space lines cancel out when summed over the number of shift (N), leaving the erroneous QSM map subject to dipole compensation.
$$\sum_{n=0}^{N-1}{QSM_n(k_x)}=\frac{L(k_x)}{D_{resol_{train}}(k_x)}$$
Data QSMnet dataset is used. For quantitative evaluation, we resized the QSMnet data by k-space cropping to 1.5 mm3 isotropic resolution for training. The original data (1 mm3 isotropic) and data resized to 1×1×3 mm3 resolution by k-space cropping were utilized as test data.
Network Training QSMnet1.5iso was trained using 1.5 mm3 isotropic data from 7 subjects. For comparison, QSMnet1.0iso was trained using 1.0 mm3 isotropic data of the same subjects.
Evaluation The proposed pipeline was compared with two scenarios: interpolation and naïve input. In the interpolation scenario, the local field map was resized to resoltrain by cropping the k-space, and the resulting QSM was interpolated to resolinput. In case of naïve input, the local field map was naïvely input into the QSMnet without considering the resolution difference. The images were compared with COSMOS and QSMnet1.0iso results both visually and quantitatively (NRMSE, SSIM, PSNR, HFEN). COSMOS and QSMnet1.0iso results were resized to 1×1×3 mm3 resolution for evaluation of anisotropic data reconstruction.

Results

In both isotropic and anisotropic data, the proposed method provided the best reconstruction quality out of the three tested scenarios (Figure 3). In particular, in the zoomed-in images, small structures are diminished in the interpolation scenario (yellow arrowheads), while the white matter structures are flattened in the naïve input results (red arrowheads). These results are further supported by the quantitative results where the proposed method provided the best metrics compared to both COSMOS and QSMnet1.0iso. The metrics computed with respect to QSMnet1.0iso displays higher performance compared to that calculated with respect to COSMOS in both isotropic and anisotropic resolution. This is because the performance of the proposed method depends on the network performance. The effect of dipole compensation on the reconstructed QSM map is shown in Figure 4. The method can also be utilized to reconstruct positive and negative susceptibility maps using Chi-sepnet7 (Figure 5; abstract #7204).

Conclusion

The proposed method enables resolution-free QSM reconstruction using QSMnet trained at a single resolution. The resulting QSM maps preserve high-frequency details, and the quantitative metrics demonstrate high quality. In practice, trained QSMnet+ available online8 can be used to reconstruct QSM with arbitrary resolution.

Acknowledgements

This work was supported by Heuron Co. Ltd., and the BK21 FOUR program of the Education and Research Program for Future ICT Pioneers, Seoul National University in 2022.

References

1. Yoon, J. et al. Quantitative susceptibility mapping using deep neural network: QSMnet. Neuroimage 179, 199–206 (2018).

2. Feng, R. et al. MoDL-QSM: Model-based deep learning for quantitative susceptibility mapping. Neuroimage 240, 118376 (2021).

3. Bollmann, S. et al. DeepQSM - using deep learning to solve the dipole inversion for quantitative susceptibility mapping. Neuroimage 195, 373–383 (2019).

4. Gao, Y. et al. xQSM: quantitative susceptibility mapping with octave convolutional and noise‐regularized neural networks. Nmr Biomed. 34, e4461 (2021).

5. Oh, G. et al. Unsupervised resolution-agnostic quantitative susceptibility mapping using adaptive instance normalization. Med Image Anal 79, 102477.

6. Jung, W., Bollmann, S. & Lee, J. Overview of quantitative susceptibility mapping using deep learning: Current status, challenges and opportunities. Nmr Biomed. 35, e4292 (2022).

7. Kim, M. et al. Chi-sepnet: Susceptibility source separation using deep neural network. in Proceedings of the 30th Annual ISMRM Meeting (2022).

8. Jung, W. et al. Exploring linearity of deep neural network trained QSM: QSMnet+. Neuroimage 211, 116619 (2020).

Figures

Figure 1. a) Overview of the proposed pipeline for an example case where the input data resolution is 0.5 mm3 isotropic and network training resolution is 1 mm3 isotropic. b-e) 1D representation of the pipeline. b) Downsampling of the local field map at multiple locations results in multiple aliased k-spaces. c) Network inference is dipole de-convolution in the image space, which is a pointwise division in k-space. d) By assembling the QSM maps, we acquire an erroneous map. e) By dipole compensation, we acquire the desired QSM map at the input resolution.

Figure 2. Extension of the method to non-integer resolution difference between input and training data. Re-sampling of the local field map can be seen as the combination of image shift, which is linear phase multiplication in k-space, and undersampling, which is aliasing in k-space. After network inference, the QSM map of the blue sampling case is shifted back to its original position by multiplying an inverse linear phase. Assuming the amount of shift is sub-voxel shift in the training resolution, the aliased k-space lines are canceled out by summing the shifted QSM images.

Figure 3. Reconstruction of a) 1 mm3 isotropic data and b) 1x1x3 mm3 data using QSMnet1.5 iso. The proposed method successfully reconstructs the small structures while the interpolation scenario smooths out the structures (yellow arrowheads). The white matter structures are flattened in the naïve input results (red arrowheads). The quantitative display the best metrics in the proposed scenario. Metrics computed with respect to QSMnet1.0 iso displays higher performance compared to that of COSMOS because the performance depends on the network performance.

Figure 4. Effect of dipole compensation on the reconstructed QSM. The checkered artifacts that is visible in the erroneous QSM before dipole compensation disappears after dipole compensation.

Figure 5. Exemplary reconstruction result of positive and negative susceptibility maps using chi-sepnet along with the proposed pipeline (Abstract #7204)

Proc. Intl. Soc. Mag. Reson. Med. 31 (2023)
4168
DOI: https://doi.org/10.58530/2023/4168