Snigdha Sen1, Saurabh Singh2, Hayley Pye3, Caroline Moore4, Hayley Whitaker3, Shonit Punwani2, David Atkinson2, Eleftheria Panagiotaki1, and Paddy J Slator1
1Centre for Medical Image Computing, University College London, London, United Kingdom, 2Centre for Medical Imaging, University College London, London, United Kingdom, 3Molecular Diagnostics and Therapeutics Group, University College London, London, United Kingdom, 4Department of Urology, University College London Hospitals NHS Foundation Trust, London, United Kingdom
Synopsis
Keywords: Signal Modeling, Microstructure
Microstructure models are traditionally fitted via computationally expensive non-linear least squares. Recent model fitting techniques use supervised deep learning algorithms trained on synthetic datasets, however the training data distribution affects parameter estimates. Self-supervised learning can address this by extracting training labels directly from the input data. We introduce a self-supervised machine learning algorithm for fitting the VERDICT MRI model for prostate to diffusion-weighted MRI. On simulated data, our approach improves parameter estimation compared to non-linear least squares and supervised machine learning. We also reveal plausible tumour contrast on in-vivo prostate data.
Introduction
Microstructure imaging combines bespoke diffusion-weighted MRI (DW-MRI) acquisitions with biophysical models to investigate sub-voxel tissue microstructure. These models are traditionally fitted using non-linear least squares (NLLS). Recent work has used supervised deep learning approaches to fit these models1-3. However, these are typically trained on large synthetic datasets, whose underlying distribution can introduce bias into fitted parameter estimates4. Self-supervised learning has the potential to address this issue by extracting training labels directly from the input data, but may also lead to higher variance5.
Self-supervised model fitting has been used successfully to improve microstructural parameter estimation for two-compartment models5-7. This work is the first to trial this approach for a complex three-compartment model. We compare three model fitting strategies – NLLS, supervised learning, and our novel self-supervised learning approach – for the VERDICT-MRI model for prostate8-10, both in simulations and in in-vivo prostate. Results show that self-supervised fitting improves parameter estimation on simulated data compared to NLLS and supervised fitting, and yields maps with plausible tumour contrast on in-vivo scans.Methods
Data Acquisition
Data from one man with biopsy-confirmed clinically significant prostate cancer from the INNOVATE clinical trial11 was analysed in this study. VERDICT-MRI data was acquired on a 3T scanner (Achieva, Philips Healthcare, Best, Netherlands), with a pulsed-gradient spin echo sequence. Imaging parameters were: TR, 2482–3945 ms; TE 50–90 ms; field of view, 220 × 220 mm; section thickness, 5 mm; no intersection gap; acquisition matrix, 176 × 176; in-plane resolution, 1.25 × 1.25 mm; b-values, 90, 500, 1500, 2000, and 3000 s/mm2. Each b-value also included a b=0 image using the same TE as the corresponding diffusion weighted image, which was used to correct each volume for T2 effects. The total imaging time was 12 minutes12.
Simulated Dataset
10,000 DW-MRI signals were simulated to quantitatively assess the performance of the self-supervised fitting against NLLS and supervised fitting. The same acquisition parameters were used as in the patient dataset, and parameter values were randomly sampled (using a uniform distribution) from biophysically plausible parameter ranges: fIC, fEES: [0,1], R: [0,15]mm and dEES: [0.5,3] mm2/ms, with the constraint fIC + fEES + fVASC = 1. Rician noise was also added, with SNR = 50.
Biophysical Model
The VERDICT prostate model has three compartments that characterise diffusion in the vascular (VASC), extracellular-extravascular space (EES) and intracellular (IC) components in tumours. These are modelled as randomly-oriented sticks (AstroSticks), Gaussian free diffusion (Ball) and restriction in an impermeable sphere (Sphere) respectively8. We estimate four model parameters: fIC (IC volume fraction), fEES (EES volume fraction), cell radius R and diffusivity dEES13,14. The vascular volume fraction is calculated as fVASC = 1 – fIC – fEES. The DW-MRI signal for VERDICT is8:
S(b)/S0 = fVASCSVASC(dVASC,b) + fICSIC(dIC,R,b) + fEESSEES(dEES,b)
where b is the b-value and S0 is the b=0 signal intensity.
Parameter Estimation
We consider three approaches: i) NLLS estimation, ii) supervised deep learning with a multilayer perceptron (MLP) consisting of three fully-connected hidden layers trained on 100,000 synthetic DW-MRI signals1,2 and iii) a novel self-supervised deep learning technique using a feed-forward, back propagation fully-connected neural network3. The network (shown in Figure 1) consists of an input layer and three fully-connected hidden layers (each with 10 neurons to match the number of diffusion-weighted acquisition volumes) and an output layer with four neurons, one for each of the parameters to be estimated.Results
Table 1 shows mean squared error (MSE) values obtained between parameter estimates and ground truth values for all three fitting strategies on simulated data. We find that self-supervised fitting produces the lowest MSE across all four VERDICT parameters. Scatter plots of parameter estimates obtained using all three strategies against ground truth values are shown in Figure 2. Visually there is stronger correlation between estimates and ground truth using self-supervised fitting. This is supported by the Pearson correlation coefficients shown both on Figure 2 and in Table 1, which are higher for self-supervised fitting than for both other methods for fIC, R and dEES.
All three fitting strategies are used to produce VERDICT parameter maps from in-vivo prostate data, which are shown in Figure 3. Self-supervised fitting produces maps with reasonable tumour contrast on in-vivo prostate data, but show increased homogeneity for fIC and fEES.Discussion and Conclusion
This work presents a comparison between three DW-MRI model fitting strategies: NLLS, supervised deep learning via an MLP and a self-supervised FCNN. Self-supervised fitting demonstrates improved performance over supervised and NLLS fitting on simulated data, in terms of MSE and Pearson correlation coefficient. VERDICT parameter maps on in-vivo prostate data show reasonable tumour contrast, but are less detailed for certain parameters. This highlights the fact that although our self-supervised approach better estimates ground truth parameters in simulations, the ultimate goal is to reliably produce in-vivo maps with tumour contrast. In future, we will extensively tune our self-supervised network hyperparameters with the aim of revealing stronger tumour contrast in real MRI data.
Future work will quantitatively compare the fitting strategies in more detail by considering bias and variance separately. We will also analyse their performance on a larger patient cohort in delineating different tissue types, and explore the generalisability of self-supervised learning to unseen data.Acknowledgements
This work is supported by the EPSRC-funded UCL Centre for Doctoral Training in Intelligent, Integrated Imaging in Healthcare (i4health) (EP/S021930/1) and the Department of Health’s NIHR-funded Biomedical Research Centre at University College London Hospitals. This work is also funded by EPSRC grant numbers EP/N021967/1, EP/R006032/1, EP/V034537/1; and by Prostate Cancer UK, Targeted Call 2014, Translational Research St.2, grant number PG14-018-TR2. The views expressed are those of the authors and not necessarily those of the NHS, the NIHR or the Department of Health.References
1. | Golkov V, Dosovitskiy A, Sperl JI, Menzel MI, Czisch M, Samann P, et al. q-Space Deep Learning: Twelve-Fold Shorter and Model-Free Diffusion MRI Scans. IEEE Trans Med Imaging. 2016 May; 35(5): p. 1344-1351. | 2. | Valindria V, Chiou E, Palombo M, Singh S, Punwani S, Panagiotaki E. Synthetic q-space learning with deep regression networks for prostate cancer characterisation with VERDICT. In IEEE International Symposium on Biomedical Imaging (ISBI); 2021. | 3. | Grussu F, Battiston M, Palombo M, Schneider T, Wheeler-Kingshott CA, Alexander DC. Deep learning model fitting for diffusion-relaxometry: a comparative study. In Computational Diffusion MRI.: Springer; 2021. p. 159-172. | 4. | Gyori NG, Palombo M, Clark CA, Zhang H, Alexander DC. Training data distribution significantly impacts the estimation of tissue microstructure with machine learning. Magn Reson Med. 2021; 87: p. 932-947. | 5. | Epstein SC, Bray TJP, Hall-Craggs M, Zhang H. Choice of training label matters: how to best use deep learning for quantitative MRI parameter estimation. ArXiv Preprint. 2022 May. | 6. | Barbieri S, Gurney-Champion OJ, Klaassen R, Thoeny HC. Deep learning how to fit an intravoxel incoherent motion model to diffusion-weighted MRI. Magn Reson Med. 2020 Jan; 83(1): p. 312-321. | 7. | Lim JP, Blumberg SB, Narayan N, Epstein S, Alexander DC, Palombo M, et al. Fitting a Directional Microstructure Model to Diffusion-Relaxation MRI Data with Self-Supervised Machine Learning. ArXiv Preprint. 2022 Oct. | 8. | Panagiotaki E, Chan RW, Dikaios N, Ahmed HU, O'Callaghan J, Freeman A, et al. Microstructural characterization of normal and malignant human prostate tissue with vascular, extracellular, and restricted diffusion for cytometry in tumours magnetic resonance imaging. Invest Radiol. 2015 Apr; 50(4): p. 218-27. | 9. | Johnston EW, Bonet-Carne E, Ferizi U, Yvernault B, Pye H, Patel D, et al. VERDICT MRI for Prostate Cancer: Intracellular Volume Fraction versus Apparent Diffusion Coefficient. Radiology. 2019 Apr; 291(2): p. 391-397. | 10. | Singh S, Rogers H, Kanber B, Clemente J, Pye H, Johnston E, et al. Avoiding Unnecessary Biopsy after Multiparametric Prostate MRI with VERDICT Analysis: The INNOVATE Study. Radiology. 2022 Aug. | 11. | Johnston E, Pye H, Bonet-Carne E, Panagiotaki E, Patel D, Galazi M, et al. INNOVATE: A prospective cohort study combining serum and urinary biomarkers with novel diffusion-weighted magnetic resonance imaging for the prediction and characterization of prostate cancer. BMC Cancer. 2016 Oct; 16(1): p. 816. | 12. | Panagiotaki E, Ianus A, Johnston E, Chan RW, Stevens N, Atkinson D, et al. Optimised VERDICT-MRI protocol for prostate cancer characterisation. In International Society for Magnetic Resonance in Medicine (ISMRM); 2015. | 13. | Bonet-Carne E, Johnston E, Daducci A, Jacobs JG, Freeman A, Atkinson D, et al. VERDICT-AMICO: Ultrafast fitting algorithm for non-invasive prostate microstructure characterization. NMR Biomed. 2019 Jan; 32(1). | 14. | Sen S, Valindria V, Slator PJ, Pye H, Grey A, Freeman A, et al. Differentiating False Positive Lesions from Clinically Significant Cancer and Normal Prostate Tissue Using VERDICT MRI and Other Diffusion Models. Diagnostics. 2022 Jul; 12(7). |
| |
| |
| | |
| |
| | |
| | |
| | |
| | |
| | |
| | |
| | |
| | |
| | |
| | |
| | |
| | |