1243

Adaptive Multi-contrast MR Image Denoising based on a Residual U-Net using Noise Level Map
Jiahao Hu1,2,3, Yilong Liu1,2, Zheyuan Yi1,2,3, Yujiao Zhao1,2, Fei Chen3, and Ed X. Wu1,2
1Laboratory of Biomedical Imaging and Signal Processing, The University of Hong Kong, Hong Kong, China, 2Department of Electrical and Electronic Engineering, The University of Hong Kong, Hong Kong, China, 3Department of Electrical and Electronic Engineering, Southern University of Science and Technology, Shenzhen, China

Synopsis

Multi-contrast MRI offers us images with complementary diagnostic information. Despite the dramatic difference in contrast, multi-contrast images often share highly correlated structure information. A deep learning (DL) based strategy is proposed to denoise multi-contrast MR images with flexible noise-levels using residual U-Net. This method utilizes the structural similarities across contrasts by simultaneously denoising multiple contrasts while existing single-contrast MRI denoising methods neglect the analogous structure information. The proposed method outperforms BM3D in terms of better noise reduction and details preservation. More importantly, we introduce a noise-level map that can be manually set to fit the different noise levels.

Introduction

Multi-contrast MRI is a useful technique to aid clinical diagnosis. It offers us multi-contrast images with complementary diagnostic information. Although the signal intensity varies dramatically across different contrasts, the underlying tissue often shares strong structural similarities or correlations. Most existing MRI denoising methods only carry out denoising on single contrast without using analogous structure information to support the restoration. Moreover, conventional deep learning (DL) based methods train a model for blindly denoising images with different noise levels, which will compromise the performance. Alternatively, the trained model is for a specific level of noise reduction, which means multiple models are needed for different noise levels. A single model that can be adjusted to fit images with varying noise levels can offer better performance and higher flexibility. This study proposes an adaptive DL-based strategy to simultaneously denoise multi-contrast MR images with different noise levels using only a single model, which is implemented by combining U-Net1 with ResNet2.

Methods

Proposed Model
MRI denoising recovers high-quality MR images y from the noisy MR images x. Generally, the neural network seeks a mapping function f that minimizes the difference between the denoised images and target noise-free images. The proposed method uses a residual U-Net architecture, which combines 4-scale U-Net and ResNet. ReLU activations are used after strided/transposed convolutional layers and between two convolutional layers within each residual block. All the convolutional layers are bias-free to impose scaling invariance.
Images of different contrasts are input as different channels. Inspired by FFDNet3 and DRUNet4, a noise level map is introduced as an additional input channel to balance noise reduction and details preservation. The noise level map can be manually adjusted to fit the input noise level, which is considered to be uniform within the FOV in this study. The model outputs denoised images as different channels.
Model Training and Evaluation
The network parameters were adjusted by minimizing the L1 loss between the denoised images and their ground-truths with Adam optimizer. A pre-trained model4 was used for initialization. 5800 multi-contrast image sets were selected from the HCP dataset. T1-weighted (T1w) images were acquired with MPRAGE with TR/TE/TI=2400/2.1/1000ms, flip angle (FA)=8°. T2-weighted (T2w) were acquired using 3D FSE with TR/TE=3200/565ms. All images have an isotropic resolution of 0.7×0.7×0.7mm3. T1w image, T2w image, and the averaged of T1w/T2w images were treated as three different contrasts. Noisy images were generated by adding complex white Gaussian noise with standard deviation (σ) ranging from 0 to 35 and used to train the proposed model.
The proposed method was also evaluated with human brain datasets acquired on a 3T Philips MRI scanner using a single-channel head coil. T1w images were acquired using 3D gradient-echo (GRE) with TR/TE=19/4ms, FA=30°, T2w images were acquired using 3D fast spin echo (FSE) with TR/TE=2500/213ms. T2-weighted FLAIR images were acquired with 3D FSE with TR/TI/TE=4800/1650/282ms. All images have an isotropic resolution of 1×1×1mm3. Complex white Gaussian noise of different levels was added to the reconstructed complex images. After that, the magnitude images were used for evaluating the proposed method.

Results

In Fig. 2, the same level of noise was added to the three images with different contrasts. Our approach preserved the structure details with noise significantly suppressed. Fig. 3 shows the robustness of the proposed method when images were corrupted with a much higher noise level. Fig. 4 indicates that our methods still performed well in noise reduction and details preservation when images of different contrasts have different noise levels. In this situation, we can adjust the noise level map to adapt the noise level of each contrast, so to achieve the best performance for all contrasts. Fig. 5 shows that even with pathology that manifested insufficient structural similarities across contrasts, the proposed method could remove noise with structural details well preserved. In contrast, BM3D removed the same level of noise but over-smoothed the image structures.

Discussion and Conclusion

Our proposed denoising method utilizes the structural similarities by simultaneously denoising multiple contrasts using a residual U-Net. It shows a satisfactory performance in both noise reduction and details preservation at different noise levels. This is achieved because the noise level map can be manually adjusted to fit different noise levels. It's worth mentioning that in the presence of slight geometrical mismatches across different contrasts, the proposed method will still work because the receptive field of the model is large enough so that our extracted information can tolerate subtle geometrical mismatches. Note that images obtained with parallel imaging will have a spatially variant noise distribution. More importantly, such spatial variation can differ across different contrasts, as they may have non-identical sampling patterns. In the future, the model can be designed to have individual noise maps for each contrast to compensate for this issue.

Acknowledgements

This study was supported by Hong Kong Research Grant Council (R7003-19, C7048-16G, HKU17112120, HKU17103819 and HKU17104020), Guangdong Key Technologies for Treatment of Brain Disorders (2018B030332001), and Guangdong Key Technologies for Alzheimer's Disease Diagnosis and Treatment (2018B030336001).

References

1. Ronneberger, Olaf, Philipp Fischer, and Thomas Brox. "U-net: Convolutional networks for biomedical image segmentation." International Conference on Medical image computing and computer-assisted intervention. Springer, Cham, 2015.

2. Kaiming He, Xiangyu Zhang, Shaoqing Ren, et al. "Deep residual learning for image recognition." Proceedings of the IEEE conference on computer vision and pattern recognition. 2016.

3. Kai Zhang, Wangmeng Zuo, Lei Zhang, et al. "FFDNet: Toward a fast and flexible solution for CNN-based image denoising." IEEE Transactions on Image Processing 27.9 (2018): 4608-4622.

4. Kai Zhang, Yawei Li, Wangmeng Zuo, et al. "Plug-and-play image restoration with deep denoiser prior." arXiv preprint arXiv:2008.13751 (2020).

5. Kostadin Dabov, Alessandro Foi, Vladimir Katkovnik, et al. "Image denoising by sparse 3-D transform-domain collaborative filtering." IEEE Transactions on image processing 16.8 (2007): 2080-2095.

Figures

Fig. 1. (a) The architecture of the proposed multi-contrast denoising method using residual U-Net by combining U-Net and ResNet. (b) Residual blocks consisting of two convolutional layers with a ReLU activation in between. (c) Strided conv2D block consisting of a convolutional layer and ReLU activation. (d) Transposed conv2D block consisting of a transposed convolutional layer and ReLU activation.

Fig. 2. The results using our proposed multi-contrast denoising method. The same level of noise (noise standard deviation σ=15) was added to simulate noisy images. Our proposed method preserved the structure details while removing noise. These noisy images were also denoised using BM3D. However, the results of BM3D were over-smoothed and suffered from severe structural details loss.

Fig. 3. The denoising results for images with a higher noise level. The same level of noise (σ=25) was added to form noisy images. The proposed method remained similar performance, while BM3D smoothed the image details even more if attempt to reduce the noise to the same level as the proposed method.

Fig. 4. The denoising results with different noise levels for different contrasts (σ=5, 15, and 25 for T1w, T2w, and FLAIR, respectively). Optimal noise level maps for each contrast were empirically determined to adapt the noise level of different contrasts. The red boxes indicate the best results for each contrast of the proposed method. Non-optimal results were also displayed to show the effect of adjusting noise level map. Again, our method could effectively remove noise without losing structural details in the noisy T2w and FLAIR images, yielding better results than BM3D method.

Fig. 5. The denoising results for clinical images with pathology. The same level of noise (σ=20) was added to form noisy images. The proposed method did not compromise the structural details in pathological regions that manifested decreased structural similarities. However, BM3D over-smoothed structures, even in normal regions.

Proc. Intl. Soc. Mag. Reson. Med. 29 (2021)
1243