Synopsis
Metabolite ratios are often
used to simplify metabolic quantification. It is often implicitly assumed that
they are also statistically favorable when both numerator and denominator
metabolites change in opposing manners. Herein, we show that even for such
cases, both sample size requirements and statistical significance depend non-trivially
on taking the ratio. We conclude that care must be taken when deciding between
ratios and absolute quantification during study design. Introduction
Metabolic ratios are used
extensively magnetic resonance spectroscopy (MRS) literature due to their
simplicity and ability to account for hardware imperfections and cerebrospinal
fluid content. Different metabolites often shift in opposing directions in many
pathologies, such as multiple sclerosis (MS) in which N-acetyl-aspartate (NAA)
levels decrease while creatine (Cr), choline (Cho) and myo-inositol (mI)
increase. On the one hand, it seems that the ratio of two metabolites
displaying opposing changes might increase their statistical favorability; on
the other hand, metabolic ratios display increased coefficients of variation
1
(CVs) compared to absolute quantification due to the combined variances of both
numerator and denominator. To adequately decide whether ratios are
statistically superior to absolute quantification, CVs alone are insufficient
and one must examine the expected change and the CVs simultaneously. Herein we examine metabolite ratios effect on
sample size and statistical significance.
Theory
Assuming both numerator and
denominator are normally distributed, X
1~N(μ
1,σ
12), X
2~N(μ
2,σ
22), their ratio X
1/X
2 has
been previously derived
2. Assuming a coefficient of variation CV
2≡σ
2/μ
2CV<0.25 for the denominator, one can perform
a series expansion and obtain a normal distribution X
1/X
2~N(μ
R,σ
R2) with μ
R=μ
1/μ
2 and σ
R2=μ
R2·(CV
12-2·ρ·CV
1·CV
2+CV
22). ρ is the correlation
coefficient. Given knowledge of a normally distributed variable in control X
c~N(μ
c,σ
c2) and patient X
p~N(μ
p,σ
p2) populations, the sample size required to observe a one-sided change in the mean Δμ=μ
p-μ
c with statistical significance α and power β is N
s=(z
1‑ασ
p‑z
βσ
c)
2/Δμ
2 (with z~N(0,1)).
Methods
We computed Ns for both NAA,
Cr and NAA/Cr, using literature values3 for white matter (WM) NAA (7.7±0.6 mM) and Cr (4.9±0.5 mM) in healthy controls, assuming the standard
deviations of both remain unchanged in patient populations. The patient WM NAA
and Cr values were varied by up to 30% (NAA decrease, Cr increase) typical
of many pathologies. The sample sizes
NNAA, NCr and Nratio required to observe the
single-sided change between controls and patients for NAA, Cr, and NAA/Cr with
a statistical significance α=5% and power β=80% were calculated.
Global
WM changes in NAA, Cr and NAA/Cr were examined using data from
two previously acquired datasets4,5: a longitudinal study of relapsing-remitting
multiple sclerosis (MS) (18 patients, ages 21-45, scanned every 6 months for 3 years), and a
cross-sectional mild traumatic brain injury (mTBI) study (26 patients, ages 33±11). A
Shapiro-Wilks test with a significance level of α=0.05 was used to validate the normality of
numerator, denominator and ratio. Pearson correlation coefficients were
computed to estimate whether one can assume ρ=0. To examine whether metabolite ratios yield
any improvements to statistical significance, an unpaired two-sided t-test was
conducted among patient and control groups for NAA, Cr and NAA/Cr.
Results
The $$$\left( \mu_{NAA}^{(patient)}, \mu_{Cr}^{(patient)} \right)$$$ plane (Fig. 1) divides in three mutually exclusive regions: Nratio<min(NNAA,NCr) (black), Nratio<min(NNAA,NCr) (gray) and Nratio=min(NNAA,NCr) (white), where all sample sizes were rounded up to the nearest integer. Clearly, a non-trivial relationship exists between numerator, denominator and ratio distributions. For example, when NAA declines by 5% and Cr rises by 5%, NCr=26, NNAA=14, Nratio=10, rendering ratios superior, while a decline of 5% in NAA and rise of 2.5% in Cr yields NCr=104, NNAA=14, Nratio=19, making absolute quantification preferable.
The statistical tests confirmed normality and lack of correlations between metabolites in our cohorts' metaboilte datasets. Reduction in WM NAA and increase in WM Cho, Cr and mI
concentrations were observed in several - but not all - time points in MS
patients compared with the pooled mean of controls. In contrast, the ratio NAA/Cr differs significantly at all time points
between patients and controls, as determined by the t-test (Fig. 2); all time
points remain significant even as the significance level is lowered to a strict
α=0.01 level. For the mTBI
cohort, only NAA and NAA/mI were statistically different between patients and
controls (α=0.05) (Fig. 3). Sample
size estimations based on the estimated population variance and mean yielded
the smallest sample size for NAA, with a slightly higher sample size required for NAA/mI (16 vs. 17).
Discussion
It
is often implicitly assumed that whenever two metabolites’ means shift in an
opposing manner, their ratio must improve detection. Herein we have shown that,
depending on the means and variances of both numerator and denominator,
metabolic ratios can either enhance or diminish statistical significance and
sample size requirements in a non-trivial manner. This impacts study design considerations and choice of diagnostic biomarkers. Our conclusions can be
considered an extension of previous studies, which have already noted the
increased CVs exhibited by ratios albeit without examining their effect on
statistical tests.
Acknowledgements
Assaf Tal acknowledges the support of the Monroy-Marks Career
Development Fund, the Carolito Stiftung Fund, the Leona M. and Harry B.
Helmsley Charitable Trust and the historic generosity of the Harold Perlman
Family. This work was also supported by
the Center for Advanced Imaging Innovation and Research (CAI2R, www.cai2r.net),
a NIBIB Biomedical Technology Resource Center (NIH P41 EB017183).References
[1] Li
BSY, Wang H, Gonen O. Metabolite ratios to assumed stsable creatine level may
confound the quantification of proton brain MR spectroscopy. Magnetic Resonance
Imaging. 2003;21(8):923-8.
[2] Hinkley
DV. On the ratio of two correlated normal random variables. Biometrika.
1969;56(3):635.
[3] Tal A, Kirov II, Grossman RI, Gonen O. The role of gray and
white matter segmentation in quantitative proton MR spectroscopic imaging. NMR
in Biomedicine. 2012;25(12):1392-400.
[4] Kirov II, Tal A, Babb JS, Herbert J, Gonen O. Serial proton MR
spectroscopy of gray and white matter in relapsing-remitting MS. Neurology.
2013;80(1):39-46.
[5] Kirov II, Tal A, Babb JS, et al. Proton MR Spectroscopy
Correlates Diffuse Axonal Abnormalities with Post-Concussive Symptoms in Mild
Traumatic Brain Injury. Journal of Neurotrauma. 2013;30(13):1200-4.