Accurate determination of peak position is challenging for spectra with dense spectral regions paired with low SNR as occuring in pH measurements using hyperpolarized [1,5-13C2,3,6,6,6-D4]zymonic acid in kidney of mice. Despite scarcity of available data from preclinical experiments, convolutional neural networks (CNN) and multilayer perceptrons (MLP) could be trained by complementing real and augmented data with synthetic spectra. While MLPs do not achieve suitable performance, CNNs predict pH compartments with an accuracy comparable or superior to supervised line fitting in synthetic test spectra. Further, CNNs allow generation of composite pH maps with improved quality while quantitatively agreeing with line-fitted maps.
We acknowledge support from Dr. Geoffrey J. Topping for help with setting up hyperpolarized 13C acquisition protocols. Further, we acknowledge support from Dr. Christian Hundshammer for help with zymonic acid polarization and synthesis and help from Sandra Sühnel with animal experiments.
This research was funded by the Deutsche Forschungsgemeinschaft (DFG, German Research Foundation, Sonderforschungsbereich (SFB) 824, subprojects A7 and Z3, grant number 391523415), the Young Academy of the Bavarian Academy of Sciences and Humanities and the European Union’s Horizon 2020 research and innovation program under grant agreement No 820374.
1. Anemone A, Consolino L, Arena F, et al. Imaging tumor acidosis: a survey of the available techniques for mapping in vivo tumor pH. Cancer Metastatis Rev. 2019;38(1-2): 25-49.
2. Düwel S, Hundshammer C, Gersch M, et al. Imaging of pH in vivo using hyperpolarized 13C-labelled zymonic acid. Nat Commun 2017, 8, 15126, doi: 10.1038/ncomms15126.
3. Chen D, Wang Z, Guo D, et al. Review and Prospect: Deep Learning in Nuclear Magnetic Resonance Spectroscopy. Chemistry 2020, 26, 10391-10401.
4. Das D, Coello E, Schulte R F, et al. Quantification of Metabolites in Magnetic Resonance Spectroscopic Imaging Using Machine Learning. In Medical Image Computing and Computer Assisted Intervention - MICCAI 2017 2017; 462-470.
5. Grashei M, Suehnel S, Topping G J, et al. Multi-compartment pH detection in healthy and tumour bearing mice using hyperpolarized deuterated [1,5-13C2]zymonic acid. Digital Poster at ISMRM2020 International Conference 2020.
6. Dozat T. Incorporating Nesterov Momentum Into Adam. In Proceedings of International Conference on Learning Representations 2016 - Workshop Track.
7. Raghunand N, Howison C, Sherry A D, et al. Renal and Systemic pH Imaging by Contrast-Enhanced MRI, Magn Reson Med. (2003); 49: 249 – 257.
Neural network architecture for the (a) CNN and the (b) MLP. Both networks consist of 4 feature extraction layers, for which they learnt a mapping between the input spectra and multiple pH compartments. The length of the spectrum or feature maps, which are used as the input to each next convolutional or dense layer, are shown in the square brackets.
a: The number of filters is 4, 4, 8, and 8. Round brackets indicate convolutional kernel sizes.
b: The number of neurons is 16, 16, 32, and 32. Dense layers are represented with half (MLP) or quarter (CNN) the number of nodes, except for output layers.
Synthesis of three pH compartment spectra for CNN- and MLP-training.
a: Normal distributions of pH values for pH compartments to generate synthetic spectra.
b: Example spectrum containing 3 pH compartments without added noise.
c: Addition of noise to obtain synthetic spectra with minimal SNR between 2 and 7 (SNR 2, 5, and 7 are shown exemplarily).
d: Exemplary spectra for five-scale Gaussian denoising to increase the real training data size. Only the first and the fifth scale-denoised spectra and an enlarged version of the spectra (green box) are shown.
a: Axial anatomical T2w image of mouse kidneys (white ROIs).
b: Segmentation mask for a hyperpolarized [1,5-13C2]zymonic acid CSI acquisition. White areas indicate voxels which contain three pH compartments as detected by voxel-wise spectra inspection and supervised line fitting.
c: Mean pH map based on voxel-wise averaging of all pH compartments being detected by manual line fitting.
d: Composite mean pH map generated from voxel-wise averaging of pH compartments. For regions with positive mask (b), pH compartments and mean pH values are obtained from CNN predictions.
a: pH Compartments derived from single kidney ROIs in pH maps generated from line fitting and composite pH maps generated from line fitting and CNN predictions as shown in Fig. 4c, d. Mean pH values of kidney compartments from both pH maps show good agreement while neural networks show less variation for pH compartment values. pH values from the kidney marked in the inset of b are indicated with a black cross.
b: ROI spectrum from region drawn in inset image (white ROI). Arrows indicate where line fitting is incomplete due to low SNR, resulting in the observed map heterogeneity in Fig. 4c.