False positive bundles in tractography
Maxime Descoteaux1, Jasmeen Sidhu1, Eleftherios Garyfallidis1, Jean-Christophe Houde1, Peter Neher2, Bram Stieltjes3, and Klaus H. Maier-Hein2

1Computer Science, Université de Sherbrooke, Sherbrooke, QC, Canada, 2German Cancer Research Center, Heindeberg, Germany, 3Basel University, Basel University Hospital, Switzerland

Synopsis

This work provides novel insights in false positive bundles produced by tractography using a highly realistic diffusion MRI phantom with known underlying white matter ground truth anatomy. This MRI phantom was used in the ISMRM 2015 Tractography Challenge. We show that regardless of the tractography pipeline used, many invalid bundles with dense and meaningful structures are found in the tractograms.

Introduction

In recent years, a multitude of debates have arisen to attempt to understand this anatomical gap in between non-human primate and human white matter neuroanatomy, where certain white matter bundles exist in the human brain but do not exist in other primates. For example, the fronto-occipital fasciculi1, superior fronto-occipital fasciculi (SFOF) and the inferior fronto-occipital fasciculi (IFOF) are human specific bundles that are often debated in literature2. Recently discovered or rediscovered bundles, such as the vertical occipital fasciculus (VOF)3 and frontal aslant tract (FAT)4, are examples of novel human specific bundles which are controversial in their existence and definition in humans.

In this work, we will add to this controversy by providing novel insights with a highly realistic diffusion MRI phantom with known underlying white matter ground truth anatomy and advanced evaluation techniques. This MRI phantom was used in the ISMRM 2015 Tractography Challenge. For the purposes of this abstract we will focus solely on the false positive connections/bundles found in the 96 submitted tractograms for this challenge and evaluate their seemingly meaningful white matter structures.

Methods

The MRI phantom was comprised of 25 well-known human white matter fasciculi5,6, representing a known ground truth. Raw diffusion data was derived from the 25 bundles for tractography. Hence, the 25 bundles inform on the spatial extent, geometry, length, size and orientations/crossings/branching of the white matter mask of the data both at the local voxel scale and global connectivity scale.

For each of the 96 tractograms, the validity of the tractogram was analyzed in context to the ground truth and the invalid connections were classified into a new tractogram of more than 100,000 streamlines. Then, candidate deterministic and probabilistic tractograms were used to manually dissect anatomically supported bundles which were not included in the phantom’s 25 ground truth bundles. The left and right FAT, SFOF, VOF and inferior and middle longitudinal fasciculi (ILF/MLF) were dissected. An automatic bundle recognition algorithm7 based on QuickBundles8 clustering was used, to find these bundles from all other 96 submitted tractograms. Clusters of 100 streamlines or more were saved, to ensure that the invalid bundles do not arise from spurious tracts.

Results

Figure 1 reports the percentage of times each invalid bundle was found (out of 96 submissions). Recall that these white matter bundles are NOT in the ground truth 25 valid bundles but are found by tractography algorithms. We note that most invalid bundles reported are frequently found and not found mostly by DTI tractograms. Figures 2 and 3 illustrate representative invalid bundles from DTI streamline tracking, HARDI deterministic and HARDI probabilistic tracking.

Figures 4 and 5 illustrate heat maps of the locations where there are the most invalid and valid bundle overlap. These maps are created by summing binarized images of invalid and valid bundles respectively. Note that the major white matter “bottlenecks” light up such as the temporal stem, locations in the brainstem area, as well as locations in the centrum semiovale and the motor strips.

Discussion and Conclusions:

Regardless of the tractography pipeline used, with or without pre-processing, with or without crossing fiber models, regardless of tractography algorithm used or streamline post-processing, many invalid bundles are found in the tractograms. The presence of invalid bundles in tractograms has been a known fact in the tractography community9,10,11,12,13, where it has been shown in toy examples that white matter ground truth configurations can easily lead to a large number of false positive bundles. However, to the best of our knowledge, this is the first time that invalid bundles are reported in a realistic brain-like phantom. What becomes alarming is how close the invalid bundles approximate true anatomical structures. These invalid bundles connect valid cortical areas and appear to be dense and well structured.

What becomes critical, is that these invalid bundles originate from a handful of “bottleneck “ or “high traffic” locations in the brain. These bottleneck locales are usually where 3 or more valid bundles come together, almost in parallel. These locales are ideal candidate locations to generate all possible endpoint pairs of connections transversing these areas.

Our objective is not to discourage the diffusion community from using tractography, as it is a vital tool that has greatly contributed to our understanding of the brain, but we would encourage critical evaluation of methods and conclusions derived from tractography results14. More importantly, it is clear that novel tractography methods are needed to better choose what local orientations are to be “connected” together. Hopefully, advanced diffusion microstructure modelling and multi-modality integration in tractography will help overcoming this limitation of tractography.

Acknowledgements

We acknowledge the work of all participants of the 2015 ISMRM Tractography Challenge. Their submissions have contributed to the success of the challenge last year and have given us insight in writting. Thanks to Ying-Chia Lin, Fang-Cheng Yeh, Jidan Zhong, Qing Ji, David Qixiang Chen, Yuanjing Feng, Arnaud Boré, Basile Pinsard, Alessia Sarica, David Romascano, Muhamed Barakovic, Anna Auría, Oscar Esteban, Alia Lemkaddem, Jean-Philippe Thiran, H. Ertan Cetingul, Fabrizio Pizzagalli, Flavio Dell'Acqua, Fabrizio Pizzagalli, Gautam Prasad, Julio Villalon, Justin Galvis, Chantal M.W. Tax, Fenghua Guo, Hamed Y. Mesri, Szabolcs Dávid, Martijn Froeling, Anneriet M. Heemskerk, Alexander Leemans, Alessia Sarica, Roberta Vasta, Antonio Cerasa, Aldo Quattrone, Ali R. Khan, Wes Hodges, Simon Alexander, Jason Yeatman, Yuanjing Feng, Chengfeng Gao, Ye Wu, Jieyan Ma, Renjie H, Qiang Li, Carl-Fredrik Westin, H. Ertan Cetingul, Benjamin L. Odry, Boris Mailhe, Mariappan S. Nadar, Alessandro Daducci, Emmanuel Caruyer, Maxime Chamberland, François Rheault, Michael Paquette, Samuel St-Jean, Gabriel Girard, Marc-Alexandre Côté, Samuel Deslauriers-Gauthier, J. Omar Ocegueda González.

References

1. Forkel, S. J., Thiebaut de Schotten, M., Kawadler, J. M., Dell’Acqua, F., Danek, A., & Catani, M. (2014). The anatomy of fronto-occipital connections from early blunt dissections to contemporary tractography. Cortex, 56, 73–84.

2. Meola, A., Comert, A., Yeh, F.-C., Stefaneanu, L., & Fernandez-Miranda, J. C. (2015). The controversial existence of the human superior fronto-occipital fasciculus: Connectome-based tractographic study with microdissection validation. Human Brain Mapping.

3. Yeatman, J. D., Weiner, K. S., Pestilli, F., Rokem, A., Mezer, A., & Wandell, B. A. (2014). The vertical occipital fasciculus: A century of controversy resolved by in vivo measurements. Proceedings of the National Academy of Sciences of the United States of America, 111(48), E5214–5223.

4. Catani, M., Mesulam, M. M., Jakobsen, E., Malik, F., Martersteck, A., Wieneke, C., … Rogalski, E. (2013). A novel frontal pathway underlies verbal fluency in primary progressive aphasia. Brain : A Journal of Neurology, 136(Pt 8), 2619–28.

5. Stieltjes, B., Brunner, R. M., Fritzsche, K. H., & Laun, F. B. (2013). Diffusion Tensor Imaging. Berlin, Heidelberg: Springer Berlin Heidelberg.

6. http://www.tractometer.org/ismrm_2015_challenge

7. Garyfallidis, E., M-A. Côté, J. Hau, G. Perchey, L. Petit, S. Cunnane, and M. Descoteaux. "Recognition of bundles in healthy and severely diseased brains." Proceeding of: International Society of Magnetic Resonance in Medicine (ISMRM). Toronto, Canada, 2015.

8. Garyfallidis, E., Brett, M., Correia, M. M., Williams, G. B., & Nimmo-Smith, I. (2012). QuickBundles, a Method for Tractography Simplification. Frontiers in Neuroscience, 6(175), 1–13.

9. Jones, D. K. (2010). Challenges and limitations of quantifying brain connectivity in vivo with diffusion MRI. Imaging in Medicine, 2(3), 341–355.

10. Jbabdi, S., & Johansen-Berg, H. (2011). Tractography: where do we go from here? Brain Connectivity, 1(3), 169–83.

11. Fillard, P., Descoteaux, M., Goh, A., Gouttard, S., Jeurissen, B., Malcolm, J., … Poupon, C. (2011). Quantitative Evaluation of 10 Tractography Algorithms on a Realistic Diffusion MR Phantom. NeuroImage, 56(1), 234–220.

12. Côté, M.-A., Girard, G., Boré, A., Garyfallidis, E., Houde, J.-C., & Descoteaux, M. (2013). Tractometer: Towards validation of tractography pipelines. Medical Image Analysis, 17(7), 857–844.

13. Caruyer, E., A. Daducci, M. Descoteaux, J-C. Houde, J-P. Thiran, and R. Verma. "Phantomas: a flexible software library to simulate diffusion MR phantoms." Proceeding of: International Society of Magnetic Resonance in Medicine (ISMRM). Milan, Italy. 6407, 2014.

14. Jbabdi, S., Sotiropoulos, S. N., Haber, S. N., Van Essen, D. C., & Behrens, T. E. (2015). Measuring macroscopic brain connections in vivo. Nature Neuroscience, 18(11), 1546–1555.

Figures

Percentage of submitted tractograms that found the frontal alsant tract (FAT), the inferior and middle longitudinal fasciculus (ILF/MLF), the superior fronto-occipital fasciculus (SFOF) and the vertical occipital fasciculus (VOF). Left and right percentages are averaged.

Representative invalid bundles from DTI deterministic tracking a)-b) and HARDI deterministic tracking c)-f).

Representative invalid bundles from HARDI probabilistic tracking.

Example of most occurring locations of intersecting invalid bundles in different coronal, sagittal and axial views

Example of most occurring locations of intersecting valid bundles in coronal, sagittal and axial views



Proc. Intl. Soc. Mag. Reson. Med. 24 (2016)
0790