2796

Integrating Spatial and Temporal Correlations into a Deep Neural Network for Low-delay Reconstruction of Highly Undersampled Radial Dynamic Images
Hidenori Takeshima1,2

1Clinical Application Research Department, Research and Development Center, Toshiba Medical Systems Corporation, Kanagawa, Japan, 2Analytics AI Laboratory, Corporate Research & Development Center, Toshiba Corporation, Kanagawa, Japan

Synopsis

This paper proposes a novel method for the reconstruction of dynamic images from highly undersampled radial k-space data. In order to take advantage of spatial and temporal correlations and reducing the reconstruction time delay, a deep neural network (DNN) was trained with additional input images displaying the aforementioned correlations. It is shown that the image quality from the proposed method is superior to that of the method based on the conventional DNN reconstruction scheme from a single input to a single output.

Introduction

The clinical use of dynamic MRI applications requires the combination of fast data acquisition and low-delay reconstruction. Known suitable methods for the reconstruction of images from highly undersampled k-space data include stack-of-stars trajectory (i.e. a stack of 2D golden-angle radial trajectories) and compressed sensing with temporal constraints.1 However, many frames (e.g. an entire series of dynamic images) are required to evaluate temporal constraints and thus this approach is not suitable for low-delay reconstruction. For low-delay reconstruction, single-image reconstruction methods are preferred. An example of such methods is the use of a DNN from a single input image to a single output image.2 However, this approach requires a higher number of spokes than the method based on temporal constraints since it does not use temporal correlations.

Methods

In order to integrate spatial and temporal correlations and achieve low-delay reconstruction, the author proposes a dynamic reconstruction method using a DNN whose inputs and output are, respectively, consecutive $$$M$$$ frames of neighboring $$$N$$$ slices and a single image to be reconstructed. As shown in Fig. 1, the proposed method reconstructs images in a frame-by-frame manner. Since each frame depends on only $$$(M-1)/2$$$ future frames, the reconstruction delay time is expected to be lower than methods based on compressed sensing. Note that the proposed method can be considered as an extension of a conventional reconstruction method using a DNN, which corresponds to the proposed method with $$$M=N=1$$$. The DNN used in the proposed method consists of convolution layers, rectified linear units (ReLU), and residual connections.3 The overview of the DNN is shown in Fig. 2. As a preprocessing step, a Fast Fourier Transform (FFT) is applied in the stack direction. For each 2D radial k-space frame, an initial image is reconstructed using a non-uniform FFT (NUFFT) and parallel imaging (PI).4 The method for reconstructing an initial image does not rely on spatial and temporal correlations with other images. Spatial and temporal correlations are integrated into the DNN. An intermediate layer consists of a convolution layer with $$$3 \times 3$$$ kernel and a ReLU. A residual connection is inserted for each 2 stacked intermediate layers. The number of intermediate layers is 10. The first and the last layer consist of only convolution layers with $$$1 \times 1$$$ kernel. The number of channels in each intermediate layer is 128. Datasets from 2 volunteers were acquired for training. A dataset from 1 volunteer was acquired for validation. All datasets include 5 Cartesian images with matrix size $$$256 \times 160 \times 16$$$. In addition, the validation dataset includes actual k-space data using a stack-of-stars trajectory. For each radial k-space frame, 21 spokes were assigned. The number of input images were set to $$$M=5$$$ and $$$N=3$$$ for the proposed method. For generating the inputs of the DNN, 10 frames were generated from the Cartesian images by simulating a radial sampling. The DNN was trained by Adaptive moment estimation (Adam) with a mean-squared-error loss function.

Results

The results using simulated radial data are shown in Fig. 3. The results for actual stack-of-stars data are shown in Fig. 4. The quality of the images reconstructed using the proposed scheme ($$$M=5, N=3$$$) is clearly improved over the images reconstructed using an NUFFT+PI and the existing scheme ($$$M=N=1$$$). In particular, the results for actual stack-of-stars data demonstrate that structures within the liver are more clearly depicted by using spatial and temporal correlations.

Discussion

The results showed that the proposed method could reconstruct dynamic images from $$$21$$$ spokes per frame, which was significantly lower than $$$45$$$ spokes reported in a projection reconstruction method using DNN.2 The results showed that the quality of images from actual stack-of-stars data was lower than that from simulated radial data. To improve the image quality, the author suggests that imperfections of MRI system sampling should be accounted for in the simulation of radial sampling. Improvement of the simulation is deferred to future work.

Conclusion

This paper proposes a novel reconstruction method integrating spatial and temporal correlations into a DNN. Unlike methods based on compressed sensing, the proposed method reconstructs images in a frame-by-frame manner and thus can be used for low-delay reconstruction. Experimental results show that the proposed method is effective for reconstruction of highly undersampled radial dynamic images.

Acknowledgements

The author thanks Mr. Yui for providing MR images.

References

1. L. Feng et al. Golden-Angle Radial Sparse Parallel MRI: Combination of Compressed Sensing, Parallel Imaging, and Golden-Angle Radial Sampling for Fast and Flexible Dynamic Volumetric MRI. Magnetic Resonance in Medicine. 2014; 72(3): 707–717.

2. Y. S. Han et al. Accelerated Projection Reconstruction MR Imaging Using Deep Residual Learning. In Proc. Intl. Soc. Mag. Reson. Med. 2017; 25: 690.

3. K. He et al. Deep Residual Learning for Image Recognition. arXiv preprint 2015; arXiv:1512.03385.

4. K. P. Pruessmann et al. Advances in Sensitivity Encoding With Arbitrary k-Space Trajectories. Magnetic Resonance in Medicine. 2001; 46(4): 638-651.

Figures

Figure 1: The proposed method for low-delay MRI reconstruction. In order to integrate spatial and temporal correlations, consecutive M frames of neighboring N slices are used as the inputs of DNN.

Figure 2: The DNN used in the proposed method. The method for reconstructing an initial image does not rely on spatial and temporal correlations with other images. Spatial and temporal correlations are integrated into the DNN.

Figure 3: The images reconstructed from simulated radial data (21 spokes/frame). The quality of the images reconstructed using the proposed scheme (M=5, N=3) is clearly improved over the images reconstructed using an NUFFT+PI and existing scheme (M=N=1).

Figure 4: The results for actual stack-of-stars data (21 spokes/frame). Structures within the liver are more clearly depicted by using spatial and temporal correlations (M=5, N=3).

Proc. Intl. Soc. Mag. Reson. Med. 26 (2018)
2796