2723

Arterial Spin Labeling Denoising with Convolutional Neural Network and Convolutional Long-Short-Term-Memory (ConvLSTM)
Qinyang Shou1, Chaitanya Gupte2, Danny JJ Wang1, and Hosung Kim2
1Laboratory of Functional MRI Technology (LOFT), Stevens Neuroimaging and Informatics Institute, University of Southern California, Los Angeles, CA, United States, 2Neuroimaging with Deep Learning Lab (NIDLL), Stevens Neuroimaging and Informatics Institute, University of Southern California, Los Angeles, CA, United States

Synopsis

The purpose of this study was to develop a deep learning algorithm for 3D spatial-temporal denoising of ASL perfusion image series. 162 datasets from the Pediatric Template of Brain Perfusion database were used for model training and testing. The results showed that the proposed method can achieve higher Peak Signal-to-Noise Ratio (PSNR) and higher Structural Similarity Index (SSIM) than averaging of the time series and using traditional Principal Component Analysis (PCA) denoising. This result was robust when reducing the input measurements to one quarter of the total measurements, which shows the potential to reduce the scan time for ASL imaging.

Introduction

Arterial Spin Labeling (ASL) is a promising imaging technique for the quantitative analysis of brain function and development. However, one of the greatest challenges affecting the reliability of ASL measurement is its relatively low Signal-to-Noise Ratio (SNR). A long scan time is needed to acquire a perfusion image with sufficient SNR. Reducing the number of measurements results in a decrease in SNR. Deep Learning (DL) methods have been applied to ASL image denoising in several previous studies, and most studies focused on denoising using the spatial features only2,3. However, temporal feature is also an important characteristic for ASL as it contains a time series of perfusion measurements. Long-short-term Memory (LSTM) is a network structure designed to learn features of the sequential data, which has the potential to perform denoising based on temporal features. In this study, we developed a novel DL algorithm to perform spatial-temporal ASL denoising with convolutional neural network (CNN) combined with convolutional LSTM (ConvLSTM) to improve SNR of ASL images with fewer input time steps.

Methods

1. Data acquisition and preprocessing
We studied 162 pCASL datasets acquired in 121 children between the age of 7 to 18 years (62M) from the Pediatric Template of Brain Perfusion database5. Images were acquired on a Siemens 3T Trio scanner using 2D EPI sequence (TR/TE=4000/12 ms, resolution 3.125×3.125×6 mm3, labeling duration 1.5s and post labeling delay 1.2s). A total of 40 control and label pairs were acquired. Data preprocessing included the following steps. First, all of the raw images were corrected for rigid head motion, perfusion image series were generated by pairwise subtraction between label and control acquisitions and were then normalized to the standard MNI space. The second step was image intensity standardization, which linearly mapped the image intensity values according to a population histogram1. The purpose of this step was to remove the bias between datasets and make the model easier to learn noise features. The ground truth perfusion images were generated by averaging across all the 40 perfusion image series. 80% of the whole dataset was randomly chosen to be used as the training set, 10% as the validation set and the rest as the test set.

2. Network and training
We implemented a CNN and ConvLSTM based network using the keras platform (keras.io). Figure 1 shows the network structure of the model. The network consisted of a global pathway and a local pathway with five layers of 3D convolutional layers and one layer of convolutional LSTM. The convolutional layers were used to capture the 3D spatial features of the image and the ConvLSTM layers were used to capture the spatiotemporal features of the perfusion image series. Each individual time step of input image was served as a channel to the input layer, and at the output, a single denoised image was produced and used to calculate the loss. Mean square error was used as the loss function and rectified linear unit (ReLU) was used as the activation function. Different time steps (20, 15, 10, 5) were used as the input to test the robustness of the model. Each of these models used the same structure and learning rate except the number of input channels. The training of each model took about 8 hours.

3. Model evaluation
The trained models were used to predict the denoised image from the test data sampled with the same input time steps. We evaluated results by calculating the Peak-Signal-to-Noise Ratio (PSNR) and Structural Similarity Index (SSIM) of the predicted denoised image and the “ground truth” 40-time-steps-averaged image on the test set. The mean PSNR and mean SSIM values were calculated across the test datasets. The results were also compared with the average of input image series fed to the models and the result using PCA-based denoising algorithm4.

Results and Discussion

Figure 2 shows the result of one individual dataset with 20-time-steps input (half of the full-time series). The output image of the CNN +ConvLSTM model showed excellent quality along all of the three axes compared to the ground-truth. Table 1 shows the statistical results of the model output compared to averaging and denoising with PCA. The results show that our DL algorithm can provide better results compared to traditional methods with the highest PSNR and SSIM (p-value < 0.0001). Figure 3 shows the output images of the model when fed separately with different numbers of input time steps as compared to the ground-truth on a representative subject. Figure 4 plots the performance metrics of the models fed with different input time steps, in which the proposed model outperformed the average method at all the time steps. With a fewer number of input time steps, the performance of denoising declined slightly in a linear fashion, which indicates that the use of more information may improve the model prediction.

Conclusion

Our model combining CNN with Convolutional LSTM for spatiotemporal ASL denoising can achieve an SNR improvement with fewer input time steps, which shows a potential to reduce the scan time for ASL acquisition. Further studies are needed to see if the proposed DL denoising algorithm can provide better quantitative analysis for brain perfusion.

Acknowledgements

No acknowledgement found.

References

1. Nyúl, László G., Jayaram K. Udupa, and Xuan Zhang. "New variants of a method of MRI scale standardization." IEEE transactions on medical imaging 19.2 (2000): 143-150.

2. Kim, Ki Hwan, Seung Hong Choi, and Sung-Hong Park. "Improving arterial spin labeling by using deep learning." Radiology 287.2 (2018): 658-666.

3. Xie, Danfeng, et al. "Denoising arterial spin labeling perfusion MRI with deep machine learning." Magnetic Resonance Imaging 68 (2020): 95-105.

4. Shao, Xingfeng, et al. "Prospective motion correction for 3D GRASE pCASL with volumetric navigators." Proceedings of the International Society for Magnetic Resonance in Medicine... Scientific Meeting and Exhibition. International Society for Magnetic Resonance in Medicine. Scientific Meeting and Exhibition. Vol. 25. NIH Public Access, 2017.

5. Avants, Brian B., et al. "The pediatric template of brain perfusion." Scientific data 2.1 (2015): 1-17.

Figures

Figure1. Network structure of the denoising model. The network is consisted of a local pathway and a global pathway. The local pathway is combined with five layers of 3D convolutional layers and one 2D ConvLSTM layer and a 3D convolutional layer at the end. Inputs to the network are several perfusion image series and the outputs are the denoised perfusion image.

Figure2 Results of the denoised image with 20 input time steps. The output denoised image of CNN+ConvLSTM with 20 time steps as input compared to the average and PCA denoised perfusion image.

Table1 Evaluation of the predicted denoised image from 16 test datasets using 20 time steps as input. The denoised images using CNN+ConvLSTM model are compared with the averaging and denoising with PCA regarding their MSE, PSNR and SSIM to the ground truth.

Figure 3 Model Outputs with different input time steps. The predictions are produced with 20, 15, 10 and 5 time steps as input using the corresponding model.

Figure 4 Statistical results of model outputs with different input time steps. MSE, PSNR and SSIM of each model are calculated as the average across the test set. The model outputs are compared with averaging.

Proc. Intl. Soc. Mag. Reson. Med. 29 (2021)
2723