2842

Rapid Zero-shot Image Denoising for Quantitative Imaging on a Point-Of-Care 46-mT-MRI System
Yiming Dong1, Beatrice Lena1, Tom O’Reilly1, Mathieu Mach1, Chinmay Rao2, Ziyu Li3, Matthias J.P. van Osch1, Andrew Webb1, and Peter Börnert1,4
1C.J. Gorter MRI Center, Department of Radiology, LUMC, Leiden, Netherlands, 2Division of Image Processing, Department of Radiology, LUMC, Leiden, Netherlands, 3Wellcome Centre for Integrative Neuroimaging, FMRIB, Nuffield Department of Clinical Neurosciences, University of Oxford, Oxford, United Kingdom, 4Philips Research Hamburg, Hamburg, Germany

Synopsis

Keywords: Low-Field MRI, Low-Field MRI, denoising

Motivation: Low-field MRI holds the promise of expanding access to healthcare. The low signal-to-noise ratio (SNR) poses a significant challenge to acquiring diagnostically useful information in a reasonable scanning time.

Goal(s): To overcome the challenge of low SNR in low-field MRI, achieving fast, self-supervised denoising.

Approach: A rapid 4D-denoising method utilizing the Zero-Shot-Noise2Noise framework is proposed, without the need for intensive network training.

Results: This method provides fast denoising in just 10-20 seconds per case and significantly boosts SNR efficiency, reducing the number of measrued TIs and TEs needed for precise, high-quality T1/T2 mapping.

Impact: This study's fast 4D-denoising approach revolutionizes low-field MRI by enhancing SNR without extensive training datasets, enabling faster, more efficient imaging and broadening diagnostic accessibility in resource-limited settings.

Introduction

Low-field MRI (<0.1T) has the potential to expand healthcare access, particularly in low- and middle-income regions1,2. However, its inherently low signal-to-noise ratio (SNR) presents a challenge in terms of scan time and spatial resolution, affecting detailed pathology detection and diagnosis. Recently, deep learning-based denoising methods have received increasing attention, and have been applied to low-field MRI data sets3,4. However, supervised learning-based denoising suffers from the lack of high-quality low-field training data, while transfer learning from networks trained on high-field MRI data5 requires careful tuning to account for differences in contrast and noise distribution. In this work, we adapted the zero-shot noise2noise (ZS-N2N)6 concept for low-field MRI and added an additional “relaxation/contrast” dimension (T1,T2) for a self-supervised, fast 4D-denoising in about 10-20 seconds per subject, potentially allowing fewer TI/TE points required for T1/T2 fitting.

Methods

Noise2noise7 has demonstrated that networks trained on noisy image pairs can achieve similar quality as conventional supervised learning. In ZS-N2N, a single source image can be down-sampled into two sub-images, whose noise shares the same distribution while remaining statistically independent. In this study, given a quantitative MR-parameter mapping dataset (source images) with dimensions (nt,nx,ny,nz), two low-resolution down-sampled images (nt,nx/2,ny/2,nz/2) can be formed by applying two 3D convolutions on the source images, with stride of two and “symmetric” kernels: $$$k_1=\left[\left[\begin{array}{cc}0.25&0\\0&0.25\end{array}\right],\left[\begin{array}{cc}0&0.25\\0.25&0\end{array}\right]\right]$$$ and $$$k_2=\left[\left[\begin{array}{cc}0&0.25\\0.25&0\end{array}\right],\left[\begin{array}{cc}0.25&0\\0&0.25\end{array}\right]\right]$$$, as $$$d_1(y)=y\circledast{k_1}$$$ and $$$d_2(y)=y\circledast{k_2}$$$. In the loss calculation for a given network $$$\hat{x}=f_{\hat{\theta}}(y)$$$, the network parameters are fitted initially with a symmetric residual-learning loss calculated as:$$L_1=\frac{1}{2}\left(\left\|d_1(y)-f_\theta\left(d_1(y)\right)-d_2(y)\right\|_2^2+\left\|d_2(y)-f_\theta\left(d_2(y)\right)-d_1(y)\right\|_2^2\right).$$Here the network is optimized between two down-sampled images $$$d_1(y)$$$,$$$d_2(y)$$$from the same source image. Secondly, the data-consistency loss is calculated by first denoising the source image and then applying down sampling:$$L_2=\frac{1}{2}\left(\left\|d_1(y)-f_\theta\left(d_1(y)\right)-d_1\left(y-f_\theta(y)\right)\right\|_2^2+\left\|d_2(y)-f_\theta\left(d_2(y)\right)-d_2\left(y-f_\theta(y)\right)\right\|_2^2\right).$$This constrains the network output to be consistent with the source image thereby avoiding overfitting to the down-sampled images. The total loss for the optimization would be $$$L_{\text{total }}=L_1+L_2$$$.

To enable a short processing time and avoid overfitting, a simplistic 3D convolutional neural network $$$f_\theta$$$ is used. It incorporates a 3D convolutional neural network structure with three convolutional layers, employing a LeakyReLU activation with a negative slope of 0.2, performing convolutions with kernel sizes of 3x3x3 in the first two layers and 1x1x1 in the third layer. The denoising pipeline is illustrated in Fig.1. For a standard inversion-recovery T1 mapping dataset with 6 TIs and a matrix size of (6,32,94,70), the network with its modest 70k parameters completes denoising of the entire dataset in less than 20 seconds on an NVIDIA RTX6000 GPU over 2000 epochs.

Four volunteer datasets were acquired on a 46 mT Halbach low-field system1 for testing using a 3D TSE sequence. Two datasets8 were acquired to estimate T2 of lipid and muscle in the calf muscle with 10 TEs and an echo-spacing of 11 ms, resolution 2.5x2.5x5mm3. Two T1 mapping8 datasets were acquired in brain (2.5x2.5x5mm3), with slightly differing parameters to achieve different contrasts: 1) TR=1250ms and 6 inversion times (TIs): 50,100,150,200,300,500 ms; 2) TR=1200ms and 6 TIs: 50,91,166,302,549,900 ms. The proposed method (4D-dataset, 3D-CNN) was compared to the original ZS-N2N (2D-CNN), two extended 3D versions either by adding the inversion time dimension (version 1) or the z-direction (version 2), and BM4D9. A simulated phantom T1 mapping (50,91,166,302,549,900 ms) study was added to test the performance of the algorithm with 3 noise levels (low,middle,high). To enable zero-mean Gaussian noise distribution of each image, a simple phase correction was performed before denoising to rotate the magnetization to the real-axis10.

Results

Figure 2 compares different denoising methods, highlighting the finer structures captured with the proposed 4D-denosing approach. Figure 3 evaluates the proposed method over three noise levels using various metrics in simulation, demonstrating increased PSNR/SSIM and reduced nRMSE with respect to the noise-free ground-truth images after denoising. Figure 4 shows T1 mapping results, contrasting the effects of using different numbers of TIs and the impacts of denoising. Figure 5 shows T2 mapping, highlighting the consistency and efficiency of our method to reduce scan time.

Discussion and conclusion

In this work, we have proposed a zero-shot denoising approach for low-field quantitative MRI, without training on any other sources. It has demonstrated its potential to allow for less fitting points in T1,T2 mapping. This is essential since, e.g., it took roughly 36 minutes8 to acquire these 6 TIs datasets, where denoising can really improve the scan-efficiency to reach the same SNR of T1,T2 mapping with reduced number of fitting points. However, the optimized choice of TIs/TEs has not been investigated yet, remaining a topic for the future. To further explore the denoising performance of a multi-contrast protocol (e.g. T1w,T2w,Flair/DWI) at low-field may also be interesting.

Acknowledgements

No acknowledgement found.

References

1. O’Reilly T, Teeuwisse WM, de Gans D, Koolstra K, Webb AG. In vivo 3D brain and extremity MRI at 50 mT using a permanent magnet Halbach array. Magn Reson Med. 2021;85(1).

2. Kimberly WT, Sorby-Adams AJ, Webb AG, et al. Brain imaging with portable low-field MRI. Nature Reviews Bioengineering. 2023;1(9).

3. Koonjoo N, Zhu B, Bagnall GC, Bhutto D, Rosen MS. Boosting the signal-to-noise of low-field MRI with deep learning image reconstruction. Scientific Reports 2021 11:1. 2021;11(1):1-16.

4. Le DBT, Sadinski M, Nacev A, Narayanan R, Kumar D. Deep Learning-based Method for Denoising and Image Enhancement in Low-Field MRI. IST 2021 - IEEE International Conference on Imaging Systems and Techniques, Proceedings. Published online 2021.

5. Man C, Lau V, Su S, et al. Deep learning enabled fast 3D brain MRI at 0.055 tesla. Sci Adv. 2023;9(38).

6. Mansour Y, Heckel R. Zero-Shot Noise2Noise: Efficient Image Denoising without any Data. In: ; 2023.

7. Lehtinen J, Munkberg J, Hasselgren J, et al. Noise2Noise: Learning image restoration without clean data. In: 35th International Conference on Machine Learning, ICML 2018. Vol 7. ; 2018.

8. O’Reilly T, Webb AG. In vivo T1 and T2 relaxation time maps of brain tissue, skeletal muscle, and lipid measured in healthy volunteers at 50 mT. Magn Reson Med. 2022;87(2).

9. Dabov K, Foi A, Egiazarian K. Video denoising by sparse 3D transform-domain collaborative filtering. European Signal Processing Conference. 2007;16(8):145-149.

10. Prah DE, Paulson ES, Nencka AS, Schmainda KM. A simple method for rectified noise floor suppression: Phase-corrected real data reconstruction with application to diffusion-weighted imaging. Magn Reson Med. 2010;64(2).

11. Van Der Walt S, Schönberger JL, Nunez-Iglesias J, et al. Scikit-image: Image processing in python. PeerJ. 2014;2014(1).

Figures

Figure 1. Proposed pipeline. The residual loss adapted noise2noise concept, optimizing the network between two down-sampled image pairs with similar structures behind but different noise. The residual loss (L1) is calculated first by denoising and then down sampling. The “data-consistency” loss (L2) is calculated first by down-sampling and then denoising. This will enable the network to “see” the original image and maintain the original perceived resolution, acting as a regularization term. The final combined loss is simply calculated as L1+L2.

Figure 2. Comparison of different denoising methods of one in-vivo T1 mapping dataset, showing two TIs. At TI = 91ms, the proposed 4D method outperforms others, the network is able to capture fine structures nicely (red arrows). At TI = 166ms, which gives the noisiest data (close to Mz zero-crossing), both the proposed 4D and BM4D restore the skull structure (red arrows) better than the others. However, in zoomed ROIs, the proposed 4D method captures details while BM4D appears to be oversmoothed. Sigma for BM4D was auto-determined using skimage11 in Python.

Figure 3. Testing the proposed method at three noise levels using average PSNR, SSIM, and nRMSE over all TIs/slices vs. clean reference in simulation. In each scenario, our method increases PSNR and SSIM and decreases nRMSE. Even at high noise at TI=166ms, where the structure is visibly completely lost in the noisy image (red arrows), the proposed method could capture the same structure from other TIs and guide the denoising/image-restoring, although the simulated SNR is much lower than reality at 46 mT.

Figure 4. T1 mapping with different numbers of TIs of one in-vivo data, without/with denoising. (Left) The original images with 6 TIs can be well denoised with the proposed method, while the denoising method can still give a reasonable result with only 3 TIs as input. (Right) The T1 mappings were performed with 6 TIs and 3 TIs, with/without denoising. All showed close T1 values of white matter (WM) within the ROIs (red), while with only 3 TIs the standard deviation was increased. The proposed method can reduce these errors. With 3 TIs measured, the scanning time can be dropped from 36 to 18 mins.

Figure 5. T2 mapping over different TEs with and without denoising of one subject’s leg. (Top) 10-TE and 3-TE images are efficiently denoised. Spike artifacts from an intense k-space point are removed during denoising, as the network is likely to detect inconsistencies between TEs. (Bottom) T2 mapping for 10 and 3 TEs shows consistent T2 values for WM in ROIs (red). With only 3 TEs, the proposed method reduces the error (standard deviation) to the level of the 10-TE fit. This can reduce scanning time from 28 minutes to almost 8 minutes.

Proc. Intl. Soc. Mag. Reson. Med. 32 (2024)
2842
DOI: https://doi.org/10.58530/2024/2842