Istvan N Huszar1, Karla L Miller1, and Mark Jenkinson1
1Wellcome Centre for Integrative Neuroimaging, FMRIB, Nuffield Department of Clinical Neurosciences, University of Oxford, Oxford, United Kingdom
Synopsis
An open-source framework (TIRL) and a novel 3-stage
pipeline are presented to automate the registration between sparsely sampled
small histology sections and 3-D MRI data for validating imaging biomarkers. In
addition to affine registration, deformable slice-to-volume registration is
employed to compensate for both in-plane and through-plane distortions of the
histology sections. Each stage of the pipeline is shown to achieve
submillimetre precise alignments, surpassing the accuracy of previous methods. With
photographic intermediaries the pipeline is fully automatic and does not depend
on serial histological sectioning or specialist cutting and stain automation
hardware. The tools are provided as part of FSL.
Introduction
There
is an increasing demand for non-invasive biomarkers that can reliably indicate
the presence and extent of neurodegeneration in its early stages. Various MRI
methods have shown great potential to indicate the event of upper motor neuron
involvement in the progression of motor neuron disease (MND) at the population
level, but these have not been systematically validated against traditional
histological markers at the individual level1. Validation relies on a precise
and preferably automatic method to align a large number of MRI and histology
images of the same tissue, which poses unique challenges compared to more
conventional MRI-to-MRI registration. Here we present a novel image
registration framework (Tensor Image Registration Library, TIRL) and
methodological validation of two registration pipelines for aligning
conventional sparsely sampled histology sections with post-mortem 3-D MRI data
through photographic intermediaries.Materials and Methods
TIRL was designed and implemented to be compatible with a
wide range of images (including histology, MRI, and photographic formats, 2-D
and 3-D images, single- and multi-channel images), has native support for slice-to-volume
registration, and allows fast prototyping of bespoke registration pipelines.
Details of the implementation have been summarised elsewhere2 and the
framework was released with FSL 6.0.4.3
Here we performed experiments to validate the accuracy of
two TIRL-based registration pipelines on a multi-modal imaging dataset that was
collected from 16 post-mortem human brains as part of a larger MND study4
(Figure 1). The formalin-fixed brains were scanned using a steady-state
free-precession sequence (TRUFI) at 0.25 mm/voxel isotropic resolution at 7T,
and dissected by hand to isolate approximately 25x30 mm large tissue blocks for
multi-modal histology. Motor blocks were excised first. The brain was
subsequently sliced into 1-cm thick coronal sections and the extramotor blocks
were extracted from these. The tissue blocks and the coronal slices were
photographed, yielding quasi-rigid intermediate reference images for the
registration between histology and MRI: one (the block-face image) for the
motor blocks and two (the block-face image and the brain slice photograph) for
the extramotor blocks.
The 3-stage pipeline was used to register stained histology
sections of the extramotor blocks to MRI space. Stage 1 employed a sequence of
rotation search, rigid, and affine initialisation that was eventually refined
by diffusion-regularised deformable registration minimising the MIND metric5.
In Stage 2, the insertion sites for the tissue block were automatically
inferred from cut-out whole-brain slice photographs (see Figure 1), and
registered in place by the same sequence of operations as in Stage 1. Stage 3
refined initial estimates of the slice position and orientation, carried out
2D-to-3D affine registration, and used 32 quasi-random control points to
optimise in-plane, then both in-plane and through-plane deformations of the
slice to compensate for the imperfections of freehand slicing.
In the 2-stage pipeline, the slice-to-volume registration
was carried out between the block-face image and the MRI volume, and the
necessary initialisation was supplied manually (Figure 2).
The accuracy of the registration was thoroughly
investigated in each case. In Stage 1, the grey-white matter boundaries (GWMB)
were manually segmented on the original histology image and the block-face
photo, and their mean distance (MCD) was measured after registration on 14
callosal and 14 hippocampal blocks. The results were compared against
registrations by ANTs6 with Mattes and cross-correlation (CC) similarity
metrics.
The accuracy of Stage 2 was evaluated on 87 blocks by visualising the
alignment of perforating vessels and measuring MCDs. In Stage 3, the alignment
was also visualised by GWMBs after each substage and estimated by registering
synthetic slices that were extracted from the 3-D MRI data and pre-deformed by
a quadratic polynomial. This experiment was repeated in the presence of
Gaussian noise (SNR=10) to test for robustness.Results
In
Stage 1 (Figure 3), TIRL registered callosal samples with 0.25 mm MCD, and
hippocampal sections with 0.4 mm MCD. For both types of blocks, higher
registration errors were observed with ANTs with both the Mattes (0.42 mm, 0.7
mm) and the CC metrics (0.28 mm, 0.65 mm).
In
Stage 2 (Figure 3), the block matching process found the correct insertion site
in 81/87 cases, and there were no visible errors in the registration. The registration
error (MCD) was less than 0.2 mm in all cases, which was also supported by the
close correspondence of perforating vascular structures.
In
Stage 3 (Figure 4), significant through-plane deformations (0-6.5 mm) were
necessary to compensate for the imperfections of freehand cutting. The distance
of the synthetic slices from the registration target was 5-10 mm at the
beginning, which fell below 0.2 mm by the end of the registration. Repeated
experiments indicated robust convergence to the registration target and this
behaviour was preserved in the presence of Gaussian noise as well.
The observed accuracies were preserved after
combining stage-specific transformations to obtain end-to-end histology-to-MRI
mapping (Figure 5) for all extramotor blocks. The alignment of the motor blocks
by TIRL was more accurate than it was manually estimated by ROIs from the Juelich
atlas (Figure 2).Conclusion
The proposed pipelines
provided robust and submillimetre accurate registration of sparsely sampled
histology images to 3-D MRI data. The automation of this process allows MRI
findings to be validated against histological ground truth in large disease
cohorts.Acknowledgements
I.N.H. was supported by funding from the Engineering
and Physical Sciences Research Council (EPSRC) and Medical Research Council (MRC)
[grant number EP/L016052/1], the Clarendon Fund and the Chadwyck-Healey
Charitable Trust at Kellogg College, Oxford, UK. The Wellcome Centre for
Integrative Neuroimaging is supported by core funding from the Wellcome Trust (203139/Z/16/Z).
The authors would like to further express their gratitude to the donors and
benefactors of the Oxford Brain Bank.References
- Bede, P., The histological
correlates of imaging metrics: postmortem validation of in vivo findings.
Amyotrophic Lateral Sclerosis and Frontotemporal Degeneration, 2019. 20(7-8):
p. 457-460.
- Huszar, I.N., et al., Tensor Image
Registration Library: Automated Non-Linear Registration of Sparsely Sampled
Histological Specimens to Post-Mortem MRI of the Whole Human Brain. bioRxiv,
2019: p. 849570.
- TIRL page of the FSLwiki: https://fsl.fmrib.ox.ac.uk/fsl/fslwiki/TIRL,
accessed on 16 Dec 2020.
- Pallebage-Gamarallage,
M., et al., Dissecting the pathobiology of altered MRI signal in amyotrophic
lateral sclerosis: A post mortem whole brain sampling strategy for the integration
of ultra-high-field MRI and quantitative neuropathology. BMC Neurosci,
2018. 19(1): p. 11.
- M.P., et al., MIND: modality
independent neighbourhood descriptor for multi-modal deformable registration.
Med Image Anal, 2012. 16(7): p. 1423-35.
[6] Avants, B.B., et al., The Insight ToolKit image registration
framework. Front Neuroinform, 2014. 8: p. 44.
-
Avants, B.B., et al., The Insight ToolKit image
registration framework. Front Neuroinform, 2014. 8: p. 44.