4667

Deep learning image formation for fast and high-resolution brain MRI at 0.055 tesla
Vick Lau1,2, Christopher Man1,2, Yujiao Zhao1,2, Linfang Xiao1,2, Alex T.L. Leong1,2, and Ed X. Wu1,2
1Laboratory of Biomedical Imaging and Signal Processing, The University of Hong Kong, Hong Kong SAR, China, 2Department of Electrical and Electronic Engineering, The University of Hong Kong, Hong Kong SAR, China

Synopsis

Keywords: AI/ML Image Reconstruction, Low-Field MRI, Brain

Motivation: High, isotropic resolution (e.g., 1mm) is desirable for lesion detection and biomarkers extraction for cognitive disorders. However, ultra-low-field (ULF) MRI severely suffers from low spatial resolution and signal-to-noise ratio.

Goal(s): To investigate the potential of 3D deep learning in generating <=1mm isotropic resolution results from 2D partial Fourier-sampled, low-resolution noisy brain images acquired from our custom-made 0.055T scanner.

Approach: We advanced 3D deep learning partial Fourier reconstruction and super-resolution method (PF-SR) to achieve 3x/4x super-resolution factors.

Results: Preliminary results indicate possibility of PF-SR with higher super-resolution factors on reconstructing experimental ULF T1w/T2w data to 1/0.75mm3 with reduced artefacts and noise.

Impact: Enhancing image resolution and fidelity for fast ultra-low-field brain imaging at 0.055T using data-driven 3D deep learning approach to <=1mm3 resolution potentially enables image-guided therapies and valuable neuroimaging analysis for assessing aging and cognitive conditions.

Introduction

Low-cost, ultra-low-field (ULF) MRI suffers from significantly lower SNR1-3 which limits spatial resolution, and multiple acquisitions are often needed to boost SNR, hindering its clinical value and adoption. Deep learning (DL) approaches have shown promising results in improving image quality of ULF images4,5. Recently, we developed a 3D DL method (PF-SR)6 for simultaneous partial Fourier (PF) reconstruction, denoising and super-resolution (SR) for 2D PF-sampled, noisy, low-resolution 3D isotropic brain images acquired from our custom-built 0.055T MRI scanner7. PF-SR demonstrated the potential of achieving high 3D image fidelity for fast ULF MRI with 3-min scan time. Yet, it was limited with a SR factor of 2x, giving only 1.5mm3 isotropic resolution results. High and isotropic resolution such as 1mm3 is more compelling and desirable as insufficient resolution can impede identification of tiny lesions and valuable downstream analysis of such structural neuroimaging data.

Unlike traditional interpolation methods or SR with multiple shifted images8,9, supervised deep learning approaches can leverage priors extracted from the training process using large-scale, high quality MRI dataset to recover loss of information. This presents a unique opportunity of tackling the ill-posed single image formation (reconstruction and restoration) problem with high SR factors. In this study, we explored the feasibility and potential of PF-SR to address the considerably more ill-posed and important problem of achieving 1mm3 and sub-millimetre (0.75mm3) isotropic resolution with 3x and 4x super-resolution factor respectively.

Methods

We adopted the basic PF-SR architecture we recently implemented6. We modified it for 3x and 4x SR factors while maintaining similar model complexity (Figure 1): (i) 3x PF-SR shared the same learnable upsampler as 2x model, but channel size of first convolution layer was increased to 1728, allowing upsampling factor of 3 after 3D pixel shuffle. (ii) For 4x PF-SR, two consecutive sub-pixel convolutions were employed, each with upsampling factor 2.

T1w and T2w models of different SR scales were trained from scratch and separately with 1248 T1w and 1182 T2w brain data, respectively, synthesised from HCP S1200 dataset10. Data were resampled to 1.5/1/0.75mm3 resolution as training targets for 2x/3x/4x SR factor respectively. Corresponding training inputs of 3mm3 resolution were generated via k-space cropping and retrospective 2D PF sampling of fraction=0.7 in both phase-encoding (PE) directions. We added Rician noise of level comparable to experimental data acquired by our 0.055T head scanner.

We used AdamW optimiser with weight decay=1e-2, batch size=8 on 4 Nvidia A100 GPUs. Random cropping with training patch size=32x32x32 and horizontal flipping were performed. All models were trained for 350 epochs using L1 loss with initial learning rate=1e-4 following a decay by factor of 2 every 50 epochs. We tested the models on both synthetic and experimental ULF data and compare the results with 3T high-resolution references. Experimental ULF data were previously acquired using our 0.055T head scanner7 with single NEX and prospective PF-sampling of fraction=0.7 along two PE directions following the parameters described in paper6.

Results

Figure 2 presents the typical reconstruction results of synthetic ULF data for different super-resolution factors. Figure 3 and 4 show the reconstruction results of experimental ULF T1w and T2w data from one young and two elderly subjects, respectively. Similar to results from 2x PF-SR, PF-SR with 3x/4x SR factor effectively reduced Gibbs-ringing artefacts, noise and recovered structures of both synthetic and experimental data but with improved clarity. However, 4x PF-SR is more prone to mistaken noise and/or artefacts as structure. The contrast consistency experiment among T1w and T2w images (Figure 5) revealed the consistency and complementarity of appearance of structural details produced by 3x and 4x PF-SR even if T1w and T2w models were trained separately, indicating PF-SR’s ability in reconstructing anatomical details.

Discussion and Conclusion

In this study, we demonstrated the potential of advancing PF-SR to 4x SR factors. PF-SR of higher SR factors give sharper results with similar artefacts and noise suppression in both synthetic and experimental ULF T1w and T2w data.

Fast ULF MRI for 3D T1w and T2w images with 1/0.75mm3 isotropic resolution potentially allows for structural volumetric quantification for assessing brain aging and neurodegenerative diseases. Potential biomarkers such as hippocampal and putamen volume associated with cognitive decline and disorders like Alzheimer’s11,12 and Huntington’s disease13 require (sub-)millimetre resolution for optimal segmentation and volumetric measurements. Precious information on brain development14 and aging process15,16 may also be obtained via measuring white and grey matter volume changes. The high resolution may also enable image-guided therapies17-20. However, more careful examinations including quantitative analysis, testing on patient data with robust radiological assessment are required in future studies.

Acknowledgements

This work was supported in part by Hong Kong Research Grant Council (R7003-19F, HKU17112120, HKU17127121, HKU17127022 and HKU17127523 to E.X.W).

References

1. Hoult DI, Richards R. The signal-to-noise ratio of the nuclear magnetic resonance experiment. Journal of Magnetic Resonance (1969) 1976;24(1):71-85.
2. Coffey AM, Truong ML, Chekmenev EY. Low-field MRI can be more sensitive than high-field MRI. Journal of Magnetic Resonance 2013;237:169-174.
3. Sarracanie M, Salameh N. Low-Field MRI: How Low Can We Go? A Fresh View on an Old Debate. Frontiers in Physics 2020;8.
4. Iglesias JE, Schleicher R, Laguna S, Billot B, Schaefer P, McKaig B et al. Quantitative Brain Morphometry of Portable Low-Field-Strength MRI Using Super-Resolution Machine Learning. Radiology 2023;306(3):e220522.
5. Lau V, Xiao L, Zhao Y, Su S, Ding Y, Man C et al. Pushing the limits of low-cost ultra-low-field MRI by dual-acquisition deep learning 3D superresolution. Magn Reson Med 2023;90(2):400-416.
6. Man C, Lau V, Su S, Zhao Y, Xiao L, Ding Y et al. Deep learning enabled fast 3D brain MRI at 0.055 tesla. Science Advances 2023;9(38):eadi9327.
7. Liu Y, Leong ATL, Zhao Y, Xiao L, Mak HKF, Tsang ACO et al. A low-cost and shielding-free ultra-low-field brain MRI scanner. Nat Commun 2021;12(1):7238.
8. Greenspan H, Oz G, Kiryati N, Peled S. MRI inter-slice reconstruction using super-resolution. Magn Reson Imaging 2002;20(5):437-446.
9. Plenge E, Poot DH, Bernsen M, Kotek G, Houston G, Wielopolski P et al. Super-resolution methods in MRI: can they improve the trade-off between resolution, signal-to-noise ratio, and acquisition time? Magn Reson Med 2012;68(6):1983-1993.
10. Van Essen DC, Smith SM, Barch DM, Behrens TE, Yacoub E, Ugurbil K. The WU-Minn Human Connectome Project: an overview. Neuroimage 2013;80:62-79.
11. Frisoni GB, Fox NC, Jack Jr CR, Scheltens P, Thompson PM. The clinical use of structural MRI in Alzheimer disease. Nature Reviews Neurology 2010;6(2):67-77.
12. Schuff N, Woerner N, Boreta L, Kornfield T, Shaw L, Trojanowski J et al. MRI of hippocampal volume loss in early Alzheimer's disease in relation to ApoE genotype and biomarkers. Brain 2009;132(4):1067-1077.
13. Harris GJ, Pearlson GD, Peyser CE, Aylward EH, Roberts J, Barta PE et al. Putamen volume reduction on magnetic resonance imaging exceeds caudate changes in mild Huntington's disease. Annals of Neurology: Official Journal of the American Neurological Association and the Child Neurology Society 1992;31(1):69-75.
14. Giorgio A, Watkins KE, Chadwick M, James S, Winmill L, Douaud G et al. Longitudinal changes in grey and white matter during adolescence. Neuroimage 2010;49(1):94-103.
15. Giorgio A, Santelli L, Tomassini V, Bosnell R, Smith S, De Stefano N et al. Age-related changes in grey and white matter structure throughout adulthood. Neuroimage 2010;51(3):943-951.
16. Gunning‐Dixon FM, Brickman AM, Cheng JC, Alexopoulos GS. Aging of cerebral white matter: a review of MRI findings. International Journal of Geriatric Psychiatry: A journal of the psychiatry of late life and allied sciences 2009;24(2):109-117.
17. Kobayashi M, Pascual-Leone A. Transcranial magnetic stimulation in neurology. The Lancet Neurology 2003;2(3):145-156.
18. Owonikoko TK, Arbiser J, Zelnak A, Shu H-KG, Shim H, Robin AM et al. Current approaches to the treatment of metastatic brain tumours. Nature reviews Clinical oncology 2014;11(4):203-222.
19. Aldape K, Brindle KM, Chesler L, Chopra R, Gajjar A, Gilbert MR et al. Challenges to curing primary brain tumours. Nature reviews Clinical oncology 2019;16(8):509-520.
20. Krauss JK, Lipsman N, Aziz T, Boutet A, Brown P, Chang JW et al. Technology of deep brain stimulation: current status and future directions. Nature Reviews Neurology 2021;17(2):75-87.

Figures

Figure 1. PF-SR architecture for different super-resolution (SR) factors (2x, 3x and 4x). 3x PF-SR utilises one subpixel convolution with 3x upsampling factor. 4x PR-SR utilises two chained subpixel convolutions each with 2x upsampling factor. PF-SR model input is a single NEX, zero-filled, 3mm isotropic image with 2D PF sampling. Model output is an enhanced image of higher resolution (1.5mm3, 1mm3 and 0.75mm3 corresponding to 2x, 3x and 4x SR factor respectively) with reduced artefacts and noise.

Figure 2. Reconstruction of synthetic low-resolution and noisy ULF (A) T1w and (B) T2w brain images with 2D PF sampling of a fraction=0.7 by PF-SR of various SR factors (2x, 3x and 4x). The synthetic test images were synthesised from HCP S1200 dataset and not present in the training set. All PF-SR models are capable of reducing artefacts, noise and improved spatial resolution of synthetically degraded data.

Figure 3. Reconstruction of experimental ULF (A) T1w and (B) T2w brain images by PF-SR of various SR factors (2x, 3x and 4x) from one young subject, acquired by our 0.055T head scanner. All PF-SR models reduced artefacts, noise and improved spatial resolution of the noisy, low-resolution experimental ULF data with 2D PF sampling of fraction=0.7, and in agreement with each other and 3T references. 3x and 4x PF-SR generally produce results with clearer edges than 2x PF-SR, indicating potential efficacy of higher SR factors.

Figure 3. Reconstruction of experimental ULF (A) T1w and (B) T2w brain images by PF-SR of various SR factors (2x, 3x and 4x) from two elderly subjects. The experimental ULF data with prospective 2D PF sampling of fraction=0.7 were acquired from our 0.055T head scanner. While both 3x and 4x PF-SR generate results with sharper edges. 4x PF-SR was more susceptible to noise and artefacts, leading to suboptimal emphasis of non-structure and blurring near cerebellum.

Figure 5. Contrast consistency of various brain tissues among T1w and T2w PF-SR with different SR factors (2x, 3x and 4x) from one young subject. Anatomical structures restored by PF-SR with different SR factors are highly consistent and complementary, indicating PF-SR. The zoom-in views also show the improvement in image fidelity for 3x and 4x SR factors, by allowing outputs of 1mm3 and 0.75mm3 isotropic resolutions.

Proc. Intl. Soc. Mag. Reson. Med. 32 (2024)
4667
DOI: https://doi.org/10.58530/2024/4667