0356

REconstruction of MR images acquired in highly inhOmogeneous fields using DEep Learning (REMODEL)
Punith B Venkate Gowda1, Asha K Kumara Swamy1, Sachin Jambawalikar2, Sairam Geethanath1,2, and Thomas Vaughan2

1Medical Imaging Research Centre, Dayananda Sagar College of Engineering, Bangalore, India, 2Dept. of Radiology, Columbia University Medical Center, New York, NY, United States

Synopsis

The aim of this study was to develop and demonstrate a supervised learning algorithm to reconstruct MR images acquired in highly in-homogeneous magnetic fields. Brain images were used to train a deep neural network. This was performed for image sizes of 32 x 32 and 64 x 64. Results obtained demonstrate REMODEL’s ability to reconstruct the images obtained in in-homogeneous magnetic fields of up to ±50 kHz with high fidelity. The root-mean-square-error for these reconstructions compared to the uncorrupted ground truth was lesser than 0.15 and significantly lesser than the corrupted images.

Motivation and Clinical relevance:

The availability of homogeneous magnetic field (<5ppm) is a critical component in modern day MR scanners to achieve clinically acceptable images. This stringent requirement escalates the expense of the superconducting magnet and hence the price of the MR machine. Reduction and/or relaxation of this constraint would have a significant impact on cost and access, resulting in increased MR value. The REMODEL method allows for reconstruction of MR images with comparable image quality to Ground Truth (GT), in the presence of high off resonance artifacts ranging up to ±50kHz.

Impact:

The cost of the MR machine can be reduced by utilizing REMODEL for reconstruction of images resulting from a magnet designed with lower homogeneity constraints. REMODEL can address off resonance artifacts at varying field strengths1 of 1.5T and Ultra High Fields (UHF) MRI. The usage of only matrix multiplications for reconstructing test data in REMODEL is expected to result in accelerated computational time.

Approach:

Data collection and pre-processing for retrospective inhomogeneous field reconstruction: Sagittal T1 weighted and MPRAGE images from 70 subjects were collected from the Human Connectome Project (HCP)2 for training the neural network. These were then converted to axial and coronal images using MeVis Lab (Fraunhofer MeVis, Germany) to train for different orientations. All these images were rotated in 90o increments to augment the data set to generate 32000 images. Off resonance artifacts were introduced by generating 12 random field maps by creating a random 2x2 matrix which was then extrapolated to cover the complete image area creating a smooth sinusoids3 as shown in figure 1a. These field maps were normalized between -1 to 1 and then multiplied by different off-resonance ranges. Here, we assumed a read out time of 4.96ms. The training data was prepared by multiplying the kspace of the image with one of twelve randomly selected off resonance phase maps (figure 1b).
Model architecture: The neural network used for training has 3 fully connected layers, 3 convolution layers followed by one deconvolution layer, similar to the network in ref 4. Tensorflow (Google Inc, USA) was the computational frame work employed to train this neural network. The kspace (nxn complex) was then reshaped to 2n2x1 real valued vector and given as input to first fully connected layer (FC1). The architecture is detailed in figure 1c. All layers were activated by Relu activation function.
Training details: We trained the network using images of size 32x32 and 64x64 with an off-resonance frequency range of ±10kHz, and ±30k and ±50kHz respectively. Adam optimizer was used with mini batches of size 128, learning rate 10-4. We used Xavier initialization for weights and applied mini batch normalization across layers. The loss function used for training was mean squared loss between the network output and target image intensity values with an additional L2 norm and regularization value of λ=10-3. Each network was trained for 600 epochs using 2 GetForce GTX 1080 Ti GPUs with 11GB memory capacity each. The performance of the resulting network was tested using the images downloaded from HCP that were not included for training, corrupted with random field maps.

Preliminary Data:

Figure 2a shows the 64x64 coronal image corrupted by ±30kHz off-resonance. The figure shows the blurring (red arrow) and pixel shifting (yellow) due to inhomogeneity. It can be observed in figure 2b that these artifacts are significantly removed by REMODEL. The line intensity profiles in figure 2d are similar to those shown for GT. Analogous results can be seen in axial and sagittal orientations in figure 2. Figures 3 and 4 show the results of REMODEL reconstructions for dimensions of 32x32 and 64x64 images corrupted by ±10kHz and ±50kHz respectively. The average and standard deviation of the Root Mean Square Error plot of over 190 examples in figure 5 quantitates the reduction of artifacts by REMODEL reconstruction with reference to the GT, as compared to the corrupted images.

Gains and Losses:

REMODEL has been demonstrated on synthetically corrupted data from a publicly available database. It is able to faithfully reconstruct the images simulated in inhomogeneous fields up to ±50kHz, which can be extended to higher off-resonance ranges without any change in implementation details. Implementation details along with source code can be found online5. The model has been trained for brain MRI datasets and for a fixed readout time. However, this can be easily extended to other body regions and for multiple readout times. The results have been demonstrated on smaller dimensions due to available computation facilities. This could be overcome with higher compute power.

Acknowledgements

This work was supported by grant funding from DST/VGST/KFIST/LII/GRD333.

References

1. Bernstein, Matt A., Kevin F. King, and Xiaohong Joe Zhou. Handbook of MRI pulse sequences. Elsevier, 2004.

2. http://www.humanconnectomeproject.org/

3. Nylund, Andreas. "Off-resonance correction for magnetic resonance imaging with spiral trajectories." (2014).

4. Zhu, Bo, Jeremiah Z. Liu, Bruce R. Rosen, and Matthew S. Rosen. "Image reconstruction by domain transform manifold learning." arXiv preprint arXiv:1704.08841 (2017).

5. https://github.com/mirc-dsi/IMRI-MIRC/tree/master/MR%20RECON/CODE/REMODEL_v0.0

Figures

Figure1: a) Field maps with off resonance ±50kHz used for training b) flow chart of the REMODEL method c) REMODEL implementation with a deep neural network architecture composed of 3 fully-connected layers (FC1 to FC3) with Relu activation function followed by 3 convolutional layer (FC3 to Image) and a deconvolution layer with Relu activation function and adam optimizer for back propogation.

Figure 2: Reconstruction performance of REMODEL compared with Fourier Transform reconstruction: (a, g, m): 64x64 reference brain images were corrupted using simulated field maps with off resonance range of ±30kHz; (b, h, n): REMODLE reconstructed images; (c, I, o): ground truth image. (d-f, j-l, p-r) shows the line intensity profile of across the line marked in the images.

Figure 3: Reconstruction performance of REMODEL compared with Fourier Transform reconstruction: (a, g, m): 32x32 reference brain images were corrupted using simulated field maps with off resonance range of ±10kHz; (b, h, n): REMODLE reconstructed images; (c, I, o): ground truth image. (d-f, j-l, p-r) shows the line intensity profile of across the line marked in the images.

Figure 4: Reconstruction performance of REMODEL compared with Fourier Transform reconstruction: (a, g, m): 64x64 reference brain images were corrupted using simulated field maps with off resonance range of ±50kHz; (b, h, n): REMODLE reconstructed images; (c, I, o): ground truth image. (d-f, j-l, p-r) shows the line intensity profile of across the line marked in the images.

Figure 5: The average and standard deviation of the Root Mean Square Error plots over 190 examples for comparison of corrupted inputs and REMODEL results with GT data at three combinations of matrix dimensions and off-resonance values.

Proc. Intl. Soc. Mag. Reson. Med. 26 (2018)
0356