2846

MRSI reconstruction pipeline in the age of Deep Learning
Stanislav Motyka1, Lukas Hingerl1, Philipp Moser1, Asan Agibetov2, Georg Dorffner2, and Wolfgang Bogner1
1Department of Biomedical Imaging and Image-guided Therapy, Medical University of Vienna, Vienna, Austria, 2Section for Artificial Intelligence and Decision Support (CeMSIIS), Medical University of Vienna, Vienna, Austria

Synopsis

Whole-brain MRSI measured with a concentric ring trajectories based FID-MRSI sequence generates large amounts of data, which makes post-processing very time-consuming (up to several hours). To speed-up the reconstruction, deep learning approaches could be applied. AUTOMAP provides an attractive solution to reconstruct data directly from non-Cartesian kSpace data. However, it requires single-channel data. Therefore, the coil combination needs to be performed in the kSpace domain. We showed that this strategy is in principle feasible, but requires future work on stability against noise.

INTRODUCTION

Recently, the combination of spatial-spectral encoding and multi-channel acquisition allowed measuring whole-brain MRSI in clinically attractive scan times1(~3-15minutes). However, this approach generates large amounts of raw data(up to 100GB for 80x80x47 voxels with 512 spectral points and 32 receive channels), which makes post-processing very time-consuming(e.g., several hours). The conventional post-processing pipeline is depicted in Fig.1.A. To speed up the reconstruction of such data, deep learning could be applied, which is known for computationally extensive training and fast interference. Several deep learning methods for reconstruction of MRI have already been proposed2. AUTOMAP3 provides a solution in which the image space domain data are reconstructed from single channel non-Cartesian kSpace data. Such an end-to-end reconstruction approach simplifies the whole reconstruction pipeline but requires the combination of multi-channel data to a single channel in kSpace domain. The purpose of our study was therefore to replace the conventional pipeline from Fig.1.A by the pipeline from Fig.1.B,which would allow a significant speed-up of the reconstruction.

METHODS

AUTOMAP reconstruction

A resolution phantom was measured at a 7T whole-body MR scanner (Magnetom, Siemens, Erlangen, Germany) with a single channel volume coil. A Concentric Ring Trajectory-based FID-MRSI sequence4 was used: FOV=220x220mm2, matrix=80x80, vector size=72, spectral bandwidth=699Hz, TA=30s.
AUTOMAP was trained on T1-weighted images with synthetic phase derived from the Human Connectome Project5. Each of N=40000 images was normalized to a random constant cn , with 0.6 <|cn|<1.2, to mimic oscillation of FID signals and non-Cartesian kSpace values were calculated by DFT.
The AUTOMAP’s proposed architecture was used with the change of the activation functions to tanh account for negative values in real and the imaginary part. Two networks were trained to reconstruct the real/imaginary part of the signal with parameters: Learning_rate=0.00002, Number_of_epochs=100, optimizer=RMSprop, momentum=0, decay=0. This approach was compared with the conventional reconstruction based on iterative Pipe-Menon density compensation and convolutional based gridding with Kaiser-Bessel kernel followed by inverse Fourier transform4. Two cases were examined, with and without noise. Quality assessments were performed.

kSpace Coil Combination

A 3D-printed coil-shape specific phantom filled with silicone oil was measured twice at the 7T Magnetom MR Scanner with a gradient-echo MRI sequence; once with the 32-channel receive elements and once with the volume element of the same dedicated head coil (NovaMedical, Wilmington, MA, USA) to determine the sensitivity profiles of each channel.: FOV=256x256mm2, Slice thickness=1.5mm, Number of slices=128, TR/TE=7.4/4.0ms, Flip angle=9°, TA=2:53 min.
A neural network architecture was proposed which consists of two convolutional layers with the ReLu after the first layer and the tanh activation after the second layer. The measured signals from different coil channels were represented as different features of the same kSpace location and the task of the network was to reduce features into a single channel.
Training data were simulated from the same dataset as was used in AUTOMAP reconstruction. However, additional, experimentally measured, sensitivity profile modulation was introduced to simulate data for each channel. The CRT kSpace data were calculated per partition and phase encoding was simulated in partition direction. The whole kSpace was normalized to one and then each partition was normalized to one. The scaling constant from the latter normalization were saved and re-applied after coil combination. The network was applied per partition, which in this case contained information from the whole volume.
The non-Cartesian data were represented as a graph, where each kSpace location was a node connected by edges to the each node in Euclidean distance smaller than 1.5 FOV-1. Each edge was weighted by the Euclidian distance. Real and imaginary parts of complex numbers were separated to independent features. The convolutional layer proposed by Kipf and Welling6 was used. As the validation data, small part of training data was used, which were not used in the training.Training parameters were: optimizer=Adam, Learning_rate=0.0001, loss=MSE, number_of_epochs=250, batch_size=10. The performance of the coil combination networks was evaluated on the validation data in cases of no noise scenario and in the presence of difference amount of noise.

RESULTS

Results of AUTOMAP reconstruction of resolution phantom is shown in the first row of Fig.2. The second row of the Fig.2 depicts the results of conventional reconstruction. Results of kSpace coil combination is depicted in Fig.3 for magnitude images and in Fig.4 for phase images.

DISCUSSION and CONCLUSION

This abstract presents the preliminary results for replacing a standard MRSI reconstruction pipeline by deep learning approaches with the main goal to speed-up the whole reconstruction. AUTOMAP is capable of reconstructing MRSI data of the resolution phantom from non-Cartesian kSpace data even if each time point is reconstructed independently and the networks were trained on brain MRI. For high SNR data, spectra look very similar to conventional reconstruction. Due to its architecture, the multichannel data can’t be directly inserted as the input to the AUTOMAP reconstruction. Therefore, to complement our reconstruction strategy, the coil combination in kSpace domain on non-Cartesian points is required. The kSpace coil combination together with AUTOMAP will accelerate the MRSI reconstruction by ~2-3 orders of magnitude. From the results presented in Fig.3 and Fig.4, in principle, such coil combination is possible, however currently not applicable due to remaining instabilities due to noise, which will be addressed in future work.

Acknowledgements

This study was supported by the Austrian Science Fund (FWF): P30701

References

1. Hingerl L, Strasser B, Moser P, et al. Towards Full-Brain {FID}-{MRSI} At 7T With 3D Concentric Circle Readout Trajectories. Proc. Jt. Annu. Meet. ISMRM-ESMRMB, Paris, Fr. 2018:618.

2. Lundervold AS, Lundervold A. An overview of deep learning in medical imaging focusing on MRI. Z. Med. Phys. 2019;29:102–127 doi: 10.1016/j.zemedi.2018.11.002.

3. Zhu B, Liu JZ, Cauley SF, Rosen BR, Rosen MS. Image reconstruction by domain-transform manifold learning. Nature 2018;555:487–492 doi: 10.1038/nature25988.

4. Hingerl L, Bogner W, Moser P, et al. Density-weighted concentric circle trajectories for high resolution brain magnetic resonance spectroscopic imaging at 7T. Magn. Reson. Med. 2018;79:2874–2885 doi: 10.1002/mrm.26987.

5. Fan Q, Witzel T, Nummenmaa A, et al. MGH-USC Human Connectome Project datasets with ultra-high b-value diffusion MRI. Neuroimage 2016;124:1108–1114 doi: 10.1016/j.neuroimage.2015.08.075.

6. Kipf TN, Welling M. Semi-Supervised Classification with Graph Convolutional Networks. 2016.

Figures

Fig.1: The A) section depicts conventional pipeline for processing MRSI data, which use water unsupressed data for estimation of weight for coil combination. The B) section depicts simplified pipeline, in which coil combination is done in kSpace. The coil combined data can be reconstructed with conventional reconstruction (blue shaded area) or neural network (pink shade area) can be used.

Fig.2: In the left side (A section) is the comparison of AUTOMAP and Conventional Reconstruction with presence of no noise. The magnitude image of the 5th FID points is depicted and two additional spectra. In the right side (B section) is the same comparison in the presence of noise.

Fig.3: Comparison of the kSpace coil combination by neural network (the middle collum) to the conventional coil combination (right collum) and ground truth (left collum), in cases of different level of noise (rows) for magnitude images. Each subplot contains three images of axial (A), sagital (C) and coronal (B) view.

Fig.4: Comparison of the kSpace coil combination by neural network (the middle collum) to the conventional coil combination (right collum) and ground truth (left collum), in cases of different level of noise (rows) for phase images. Each subplot contains three images of axial (A), sagital (C) and coronal (B) view.

Proc. Intl. Soc. Mag. Reson. Med. 28 (2020)
2846