Pim Pullens1, Andrew IR Maas2, David Menon3, Wim van Hecke4, Jan Verheyden4, Lene Claes4, Paul M Parizel1, and On behalf of CENTER-TBI participants and investigators5
1Radiology, Antwerp University Hospital & University of Antwerp, Antwerp, Belgium, 2Neurosurgery, Antwerp University Hospital & University of Antwerp, Antwerp, Belgium, 3Anaesthesia, University of Cambridge, Cambridge, United Kingdom, 4icometrix NV, Leuven, Belgium, 5University Hospital Antwerp, Antwerp, Belgium
Synopsis
Traumatic Brain Injury (TBI) is regarded as “the
most complex disease in our most complex organ”. Clinical
outcome is unpredictable, especially in repetitive mild TBI, in terms of
behavior, cognition, emotion and associated long-term effects such as dementia. The Collaborative
European NeuroTrauma Effectiveness Research in TBI (CENTER-TBI) study is a pan-European prospective longitudinal observational study
aiming to improve care for TBI patients. One of the key goals is to improve the
quality of imaging-derived data by the application of a clinical standardized MR imaging
protocol including structural, SWI, DTI and rs-fMRI, across up to 25 clinical sites in a large, heterogeneous sample of TBI
patients. Harmonization of these protocols has been a challenging task. As data collection is underway, 265 datasets have been inspected for quality. Data quality is variable across sites and scanners. In order for such large-scale observational
studies to be really effective, sequence harmonization and standardization is
of key importance, but lacking at the moment.Purpose
Traumatic Brain Injury (TBI) is regarded as “the
most complex disease in our most complex organ”[1]. Clinical
outcome is unpredictable, especially in repetitive mild TBI, in terms of
behavior, cognition, emotion and associated long-term effects such as dementia
etc. Today’s workhorse in diagnosing TBI is CT, which is widely available, fast
and cost-effective. However, CT may not be the optimal diagnostic tool in TBI
since the full extent of structural abnormalities is not detected and there may
be a mismatch between CT findings and neurological examination. For instance,
traumatic axonal injury may remain undetected but can lead to significant
behavioral or cognitive problems. Dedicated MR examination is likely more
sensitive to TBI, though there is no consensus about the the most effective MR
protocol. The Collaborative European
NeuroTrauma Effectiveness Research in TBI (CENTER-TBI) study [1] is a pan-European prospective longitudinal observational study
aiming to improve care for TBI patients. One of the key goals is to improve the
quality of imaging-derived data by the application of a standardized MR imaging
protocol across up to 25 clinical sites in a large, heterogeneous sample of TBI
patients. To be able to make inferences about disease progression and outcome, as
shown in figure 1, MR data, MR acquisition and MR quality needs to be
consistent across sites.
Methods
A 3T MR protocol consisting of 3D T2, 3D FLAIR, 3D T1, SWI,
DTI and rs-fMRI is devised [2] for assessment of structure
and function of the injured brain as described in figure 1. The protocol needs to be fit to be used in a
clinical setting, with a scan time limit of around 45 minutes, using clinically
available protocols. Harmonization is achieved on three scanner models of the
main vendors with vendor assistance. The protocol is distributed electronically
to participating sites and adapted to the local scanner configuration. For
quality control, DWI [3] and DTI phantoms [4], [5] are sent to the sites along
with a dedicated scan protocol. A site can start patient enrollment after
central reading and approval of a healthy volunteer dataset. Patient data is
centrally collected and inspected visually for quality by an imaging contract
research organization.
Results
Protocol
implementation was challenging and time-consuming because of large
heterogeneities in scanner hard- and software configuration, see table 1. Full protocol
harmonization could not be achieved, especially for T1, DTI and SWI because of
differences in sequence implementation between the 3 main vendors, scanner
model, differences in software versions and licenses. Scan time
for the entire protocol is variable between scanners, ranging from 42-55 minutes.
Data is uploaded to a central XNAT (www.xnat.org) server: https://neuro-imaging.center-tbi.eu.
Visual quality control is performed on 265 patient datasets from 11 sites and
classified into a) interpretable for a radiologist, b) usable for automated
analyses or c) unusable. For T2, 3.4% of scans were classified as unusable,
92.1% interpretable, 4.5% was not acquired. For T1: 1.9/95.8/2.3%, FLAIR:
4.1/92.5/3.4%, SWI: 3.4,92.1,4.5%, DTI (unusable/usable/no data): 29.6/56.6/13.8%,
fMRI:13.6/79.2/7.2%. Figures 2 and 3 show the quality metrics. None of the
datasets was completely artifact-free. Site performance is variable, minimum
performance is 87.5% (of 40 patients in that site) usable anatomical data, 9.1%
(of 11) usable DTI data, 0% (of 11) usable fMRI data. Fig 3 shows quality
differences across vendors for the T1, T2, FLAIR and SWI data.
Discussion
Protocol harmonization is a challenging task because of lack
of standardization of sequences across vendors. Our experience is that within a
vendor, sequences are not standardized between software releases. Secondly, best
data quality can not be realized because compromises need to made in order to
obtain matching protocols between scanners and to achieve protocol that works
in a clinical setting. This aim has been achieved in other studies (e.g. [6]) which involve small numbers
of research active sites. The solutions achieved in these settings may not
generalizable to larger studies which involve clinically busy sites that do not
have an active imaging research program. Regardless of successful
harmonization, it is essential to establish protocols that work in a clinical
setting. Our experiences tell us that TBI patients can
be un-cooperative so the long scan time results in decreased data quality, especially for DTI.
Conclusion
In
order for such large-scale observational studies to be really effective,
sequence harmonization and standardization is of key importance, but lacking at
the moment. For traumatic brain injury patients, where
patients may be confused or disoriented, an effort should be made to reduce
scan time to avoid data corruption due to motion.
Acknowledgements
No acknowledgement found.References
[1] A. Maas, D. Menon, E. Steyerberg, G.
Citerio, F. Lecky, G. Manley, S. Hill, V. Legrand, and A. Sorgner, Collaborative
European NeuroTrauma Effectiveness Research in TBI (CENTER-TBI). Neurosurgery 2015, 76(1):67-80
2] P. Pullens, “Development of a common MRI
protocol for the collaborative European neuro trauma effectiveness research in
TBI study.” European Congress of Radiology 2015, p. B–0294, 01-Jan-2015.
[3] P. Pullens, P. Bladt, and P. Parizel, “A
Highly Standardized, Easy to Produce and Cost-Effective Isotropic PVP Diffusion
Phantom for Quality Assessment and Multi-Center Studies,” in Proc ISMRM 23,
2015, p. 2760.
[4] F. B. Laun, S. Huff, and B. Stieltjes, “On
the effects of dephasing due to local gradients in diffusion tensor imaging
experiments: relevance for diffusion tensor imaging fiber phantoms.,” Magn.
Reson. Imaging, vol. 27, no. 4, pp. 541–8, May 2009.
[5] “HQ Imaging, Heidelberg, DE.” [Online].
Available: www.hq-imaging.de.
[6] J. K. Yue, M. J. Vassar, H. Lingsma, S. R.
Cooper, E. L. Yuh, P. Mukherjee, a M.
Puccio, W. Gordon, D. O. Okonkwo, a
Valadka, D. M. Schnyer, a Maas, G. T. M.
D. P. D. Manley, S. S. Casey, M. Cheong, K. Dams-O’Connor, a J. Hricik, E. E. Knight, E. S. Kulubya, D.
Menon, D. J. Morabito, J. L. Pacheco, and T. K. Sinha, “Transforming Research
and Clinical Knowledge in Traumatic Brain Injury (TRACK-TBI) Pilot: Multicenter
Implementation of the Common Data Elements for Traumatic Brain Injury,” J.
Neurotrauma, vol. 1844, pp. 1831–1844, 2013.