1635

xQSM: a deep learning QSM network using Octave Convolution
Yang Gao1, Xuanyu Zhu1, Stuart Crozier 1, Feng Liu1, and Hongfu Sun1
1University of Queensland, Brisbane, Australia

Synopsis

Deep learning frameworks are emerging methods for solving ill-posed inverse problems in medical imaging, including Quantitative Susceptibility Mapping (QSM). Previously, U-net has been successfully trained on susceptibility maps to learn the dipole inversion process; however, susceptibility contrast loss was observed in iron-rich deep grey matter regions. In this study, we propose an enhanced deep learning network “xQSM” using the state-of-the-art Octave Convolution, which shows more accurate susceptibility contrasts than the original U-net in both simulated and in vivo datasets.

Introduction

QSM is a valuable MRI post-processing technique, which extracts magnetic susceptibility distributions from GRE phase images. However, QSM reconstruction has long been challenging due to the requisite ill-posed dipole inversion. Deep learning frameworks are emerging as alternative methods for solving ill-conditioned inverse problems in medical imaging, including QSM1,2. Two methods, DeepQSM1 and QSMnet2, have successfully trained the U-net3 for QSM using synthetic phantoms and in vivo COSMOS maps. However, susceptibility contrast loss was observed in iron-rich deep grey matter regions. In this study, we propose an enhanced U-net framework, named xQSM, via replacing traditional convolution with the recently proposed Octave Convolution (OctConv)4 to recover the susceptibility contrast loss in the original U-net based methods.

Methods

xQSM deep neural network
The xQSM framework is shown in Figure 1. As illustrated in the middle row, OctConv4 explicitly factorises the input feature maps into high and low resolution groups {XH , XL} and introduces an “X”-shaped communication between the feature maps. We also modified the original OctConv4 by replacing the nearest-neighbour interpolation with a transposed convolution to allow more learnable parameters. The modified OctConv operation is formulated as:

ƑHH = ConvHH(XH) , ƑHL = AvgPool(ConvHL(XH))
ƑLH =ConvT(ConvLH(XL)) , ƑLL = ConvLL(XL)

where Conv(·) represents convolution operations with subscripts representing different kernels; ConvT(·) represents transposed convolution of kernel size 2, which doubles the resolution of feature maps; AvgPool(·) is the average pooling operation of stride 2, which halves the resolution of feature maps.
The xQSM is built on a backbone U-net and comprises 2 OctConv layers, 2 max pooling layers, 2 transposed convolution layers, 1 final convolutional layers, 12 batch normalization layers, and 2 concatenations, as shown in Figure 1 bottom row. A total of 15,000 cropped small patches (size: 483) were generated from 96 in vivo QSM subjects to train both xQSM and the backbone U-net. All network parameters were initialised with normally distributed random numbers of zero mean and 0.01 standard deviation. Adaptive moment estimation was used to optimise the network. It took 6-8 hours (i.e., 40 epochs) to complete the network training on two Tesla V100 GPUs using MATLAB, with the mini-batch size of 32 and mean squared error as the loss function.

Validation with simulated and in vivo datasets
Simulated magnetic field maps were generated, by a forward calculation, from a 3D Shepp-Logan phantom (susceptibilities of 0, 0.2, 0.3, and 1 ppm for various ellipsoids) and a COSMOS acquisition (1 mm isotropic) at 7 T. In vivo local field maps post-processed from a healthy subject at 7 T (0.6 mm isotropic) and another 3 healthy subjects at 3 T (1 mm isotropic) were also obtained. The proposed xQSM was compared with the original U-net and conventional dipole inversion methods (iLSQR5 and MEDI6). Local field maps from a patient with multiple sclerosis at 3 T (1 mm isotropic) and a mouse brain at 9.4 T (0.1 mm isotropic) were also tested for the generalization of the xQSM network.

Results

Figure 2 compares xQSM and U-net results on the 3D Shepp-Logan phantom. Although both networks were trained with in vivo brain images, they were able to recover QSM distribution of the simplified geometrical shapes. This suggests that the deep networks have learned the underpinning dipole inversion process instead of merely memorising the features of training sets. Both the error maps and the ROI measurements in the bar chart showed that our xQSM incorporating OctConv surpassed the backbone U-net with conventional convolution.

Simulation results from COSMOS are shown in Figure 3. The proposed xQSM method achieved similar accuracies (PSNR and SSIM) as conventional iLSQR and MEDI methods, while the original U-net substantially underestimated susceptibilities of deep grey matter (orange arrows), especially Globus Pallidus. The improved susceptibility contrast from U-net to xQSM is also confirmed by the ROI measurements in the bar graph.

QSM results from an in vivo local field map (0.6 mm isotropic) acquired at 7 T are shown in Figure 4 top two rows. The proposed xQSM successfully recovered the susceptibility contrast loss as appeared in the original U-net. Susceptibility measurements of deep grey matter from 4 healthy subjects are reported in the bar graph. The xQSM measurements are consistent with conventional iLSQR and MEDI methods, while U-net significantly underestimated globus pallidus (P = 0.018) and caudate (P = 0.034) susceptibilities.

Figure 5 demonstrates that xQSM can detect the white matter lesions in a multiple sclerosis patient (red arrows), and can also reconstruct mouse brain QSM with a much higher spatial resolution (100 microns), which suggests the general capability and robustness of the method.

Discussion and conclusion

The suppressed susceptibility contrast in deep grey matter from the original U-net may be due to the truncation of dipole field in the cropped training patches. The state-of-the-art OctConv is specifically designed for such multi-resolution tasks via focusing on multi-resolution/scale learning ability of deep networks. In this work, we proposed an xQSM network implementing OctConv to reduce the redundancy of the network parameters and enhance the multi-scale learning ability. The xQSM led to high-quality QSM reconstructions with improved deep grey matter susceptibility contrast than the original U-net in both simulation and in vivo experiments.

Acknowledgements

No acknowledgement found.

References

1. Bollmann, S., Rasmussen, K. G. B., Kristensen, M., Blendal, R. G., Østergaard, L. R., Plocharski, M., … Barth, M. (2019). DeepQSM - using deep learning to solve the dipole inversion for quantitative susceptibility mapping. NeuroImage.

2. Yoon, J., Gong, E., Chatnuntawech, I., Bilgic, B., Lee, J., Jung, W., … Lee, J. (2018). Quantitative susceptibility mapping using deep neural network: QSMnet. NeuroImage.

3. Ronneberger, O., Fischer, P., & Brox, T. (2015). U-net: Convolutional networks for biomedical image segmentation. Lecture Notes in Computer Science (Including Subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics).

4. Y. Chen et al., "Drop an Octave: Reducing Spatial Redundancy in Convolutional Neural Networks with Octave Convolution", arXiv.org, 2019. [Online]. Available: https://arxiv.org/abs/1904.05049.

5. Li, W., Wang, N., Yu, F., Han, H., Cao, W., Romero, R., … Liu, C. (2015). A method for estimating and removing streaking artifacts in quantitative susceptibility mapping. NeuroImage.

6. Liu, J., Liu, T., De Rochefort, L., Ledoux, J., Khalidov, I., Chen, W., … Wang, Y. (2012). Morphology enabled dipole inversion for quantitative susceptibility mapping using structural consistency between the magnitude image and the susceptibility map. NeuroImage.

Figures

Figure 1. The first row demonstrates the preparation process of the training datasets. The bottom row illustrates the xQSM network based on the U-net backbone. Octave convolution is shown in the middle row, which introduces an “X”-shaped operation (ƑHL and ƑLH) for communication between feature maps of different resolutions.

Figure 2. Comparison of xQSM and U-net on a Shepp-Logan phantom. QSM results and error maps of a central slice are shown in the top two rows. ROI measurements (mean and standard deviation) of the 5 structures with different susceptibilities are reported in the bar graph.

Figure 3. Comparison of different QSM methods on 1 mm COSMOS data. QSM results and error maps of an axial central slice are shown in the top two rows. ROI measurements (mean and standard deviation) of six deep grey matter regions are plotted in the bar graph. Orange arrows point to significant underestimation of the U-net method.

Figure 4. Comparison of different QSM methods on in vivo local field maps from healthy subjects. The 0.6 mm isotropic QSM results and the zoomed-in deep grey matter structures are shown in the top two rows. Bar chart shows the ROI measurements of the three deep grey matter structures over 4 healthy subjects. Asterisks indicate significant difference between xQSM and U-net.

Figure 5. Demonstration of xQSM reconstruction results of a multiple sclerosis patient (1 mm) and a mouse brain (0.1 mm) in three orthogonal views. Red arrows point to the MS lesions identified by both T1-weighted and QSM.

Proc. Intl. Soc. Mag. Reson. Med. 28 (2020)
1635