Yang Gao1, Xuanyu Zhu1, Stuart Crozier 1, Feng Liu1, and Hongfu Sun1
1University of Queensland, Brisbane, Australia
Synopsis
Deep learning frameworks
are emerging methods for solving ill-posed inverse problems in medical imaging,
including Quantitative Susceptibility Mapping (QSM). Previously, U-net has been
successfully trained on susceptibility maps to learn the dipole inversion
process; however, susceptibility contrast loss was observed in iron-rich deep
grey matter regions. In this study, we propose an enhanced deep learning
network “xQSM” using the state-of-the-art Octave Convolution, which shows more
accurate susceptibility contrasts than the original U-net in both simulated and
in vivo datasets.
Introduction
QSM is a valuable MRI
post-processing technique, which extracts magnetic susceptibility distributions
from GRE phase images. However, QSM reconstruction has long been challenging
due to the requisite ill-posed dipole inversion. Deep learning frameworks are emerging
as alternative methods for solving ill-conditioned inverse problems in medical
imaging, including QSM1,2. Two methods, DeepQSM1 and
QSMnet2, have successfully trained the U-net3 for QSM using
synthetic phantoms and in vivo COSMOS
maps. However, susceptibility contrast loss was observed in iron-rich deep grey
matter regions. In this study, we propose an enhanced U-net framework, named
xQSM, via replacing traditional convolution with the recently proposed Octave Convolution
(OctConv)4 to recover the susceptibility contrast loss in the
original U-net based methods.Methods
xQSM deep neural network
The xQSM framework is
shown in Figure 1. As illustrated in the middle row, OctConv4 explicitly
factorises the input feature maps into high and low resolution groups {XH , XL}
and introduces an “X”-shaped communication between the feature maps. We also modified
the original OctConv4 by replacing the nearest-neighbour interpolation
with a transposed convolution to allow more learnable parameters. The modified
OctConv operation is formulated as:
ƑHH = ConvHH(XH) , ƑHL = AvgPool(ConvHL(XH))
ƑLH =ConvT(ConvLH(XL)) , ƑLL = ConvLL(XL)
where Conv(·) represents convolution
operations with subscripts representing different kernels; ConvT(·) represents transposed convolution of kernel size 2, which doubles
the resolution of feature maps; AvgPool(·)
is the average pooling operation of stride 2, which halves the resolution of feature
maps.
The xQSM is built on a
backbone U-net and comprises 2 OctConv layers, 2 max pooling layers, 2
transposed convolution layers, 1 final convolutional layers, 12 batch
normalization layers, and 2 concatenations, as shown in Figure 1 bottom row. A
total of 15,000 cropped small patches (size: 483) were generated from
96 in vivo QSM subjects to train both
xQSM and the backbone U-net. All network parameters were initialised with normally
distributed random numbers of zero mean and 0.01 standard deviation. Adaptive
moment estimation was used to optimise the network. It took 6-8 hours (i.e., 40
epochs) to complete the network training on two Tesla V100 GPUs using MATLAB,
with the mini-batch size of 32 and mean squared error as the loss function.
Validation with
simulated and in vivo datasets
Simulated magnetic field
maps were generated, by a forward calculation, from a 3D Shepp-Logan phantom
(susceptibilities of 0, 0.2, 0.3, and 1 ppm for various ellipsoids) and a COSMOS
acquisition (1 mm isotropic) at 7 T. In
vivo local field maps post-processed from a healthy subject at 7 T (0.6 mm
isotropic) and another 3 healthy subjects at 3 T (1 mm isotropic) were also
obtained. The proposed xQSM was compared with the original U-net and
conventional dipole inversion methods (iLSQR5 and MEDI6).
Local field maps from a patient with multiple sclerosis at 3 T (1 mm isotropic)
and a mouse brain at 9.4 T (0.1 mm isotropic) were also tested for the
generalization of the xQSM network. Results
Figure 2 compares xQSM
and U-net results on the 3D Shepp-Logan phantom. Although both networks were trained
with in vivo brain images, they were
able to recover QSM distribution of the simplified geometrical shapes. This suggests
that the deep networks have learned the underpinning dipole inversion process instead
of merely memorising the features of training sets. Both the error maps and the
ROI measurements in the bar chart showed that our xQSM incorporating OctConv surpassed
the backbone U-net with conventional convolution.
Simulation results from COSMOS
are shown in Figure 3. The proposed xQSM method achieved similar accuracies (PSNR
and SSIM) as conventional iLSQR and MEDI methods, while
the original U-net substantially underestimated susceptibilities of deep grey
matter (orange arrows), especially Globus Pallidus. The improved susceptibility
contrast from U-net to xQSM is also confirmed by the ROI measurements in the
bar graph.
QSM results from an in
vivo local field map (0.6 mm isotropic) acquired at 7 T are shown in Figure 4 top
two rows. The proposed xQSM successfully recovered the susceptibility contrast
loss as appeared in the original U-net. Susceptibility measurements of deep
grey matter from 4 healthy subjects are reported in the bar graph. The xQSM
measurements are consistent with conventional iLSQR and MEDI methods, while
U-net significantly underestimated globus pallidus (P = 0.018) and
caudate (P = 0.034) susceptibilities.
Figure 5 demonstrates that
xQSM can detect the white matter lesions in a multiple sclerosis patient (red
arrows), and can also reconstruct mouse brain QSM with a much higher spatial
resolution (100 microns), which suggests the general capability and robustness
of the method. Discussion and conclusion
The suppressed
susceptibility contrast in deep grey matter from the original U-net may be due
to the truncation of dipole field in the cropped training patches. The
state-of-the-art OctConv is specifically designed for such multi-resolution
tasks via focusing on multi-resolution/scale learning ability of deep networks.
In this work, we proposed an xQSM network implementing OctConv to reduce the
redundancy of the network parameters and enhance the multi-scale learning
ability. The xQSM led to high-quality QSM reconstructions with improved deep
grey matter susceptibility contrast than the original U-net in both simulation
and in vivo experiments.Acknowledgements
No acknowledgement found.References
1.
Bollmann, S., Rasmussen, K. G. B., Kristensen, M., Blendal, R. G., Østergaard,
L. R., Plocharski, M., … Barth, M. (2019). DeepQSM - using deep learning to
solve the dipole inversion for quantitative susceptibility mapping. NeuroImage.
2. Yoon, J., Gong, E.,
Chatnuntawech, I., Bilgic, B., Lee, J., Jung, W., … Lee, J. (2018).
Quantitative susceptibility mapping using deep neural network: QSMnet.
NeuroImage.
3. Ronneberger, O.,
Fischer, P., & Brox, T. (2015). U-net: Convolutional networks for
biomedical image segmentation. Lecture Notes in Computer Science (Including
Subseries Lecture Notes in Artificial Intelligence and Lecture Notes in
Bioinformatics).
4. Y. Chen et al.,
"Drop an Octave: Reducing Spatial Redundancy in Convolutional Neural
Networks with Octave Convolution", arXiv.org, 2019. [Online]. Available:
https://arxiv.org/abs/1904.05049.
5. Li, W., Wang, N., Yu,
F., Han, H., Cao, W., Romero, R., … Liu, C. (2015). A method for estimating and
removing streaking artifacts in quantitative susceptibility mapping.
NeuroImage.
6. Liu, J., Liu, T., De
Rochefort, L., Ledoux, J., Khalidov, I., Chen, W., … Wang, Y. (2012).
Morphology enabled dipole inversion for quantitative susceptibility mapping
using structural consistency between the magnitude image and the susceptibility
map. NeuroImage.