Fundamentals of Deep Learning
Efrat Shimron1
1University Of California, Berkeley, Berkeley, CA, United States

Synopsis

Keywords: Image acquisition: Machine learning

This educational talk will present core concepts in deep learning, including convolutional neural networks (CNNs), batch-normalization, and loss functions. Next, it will review architectures such as encoder-decoder, GANs, and physics-guided unrolled neural networks. Finally, it will present guidelines for careful design of training databases and discuss caveats of current deep learning techniques.

Overview

Deep learning (DL) techniques are continuously making a high impact on the MRI field, improving tasks ranging from image reconstruction to data annotation and classification. This talk will introduce core concepts employed in DL, including convolutional layers, batch normalization, dropout, activation functions, loss functions, and optimization techniques. Then, we will discuss architectures that are useful for image reconstruction, e.g., encoder-decoder, generative adversarial networks (GANs), variational networks, and physics-guided unrolled networks. We will also discuss how to carefully choose training data from online public databases, in a task-adequate manner. Finally, we will discuss limitations and caveats of current techniques.

Acknowledgements

This work was supported by the Weizmann Institute Women’s Postdoctoral Career Development Award in Science.

References

1. Bengio, Yoshua, Ian Goodfellow, and Aaron Courville. Deep learning. Vol. 1. Cambridge, MA, USA: MIT press, 2017.

2. Hammernik, Kerstin, et al. "Physics-driven deep learning for computational magnetic resonance imaging." arXiv preprint arXiv:2203.12215 (2022).

3. Wang, Shanshan, et al. "Deep learning for fast MR imaging: a review for learning reconstruction from incomplete k-space data." Biomedical Signal Processing and Control 68 (2021): 102579.

Proc. Intl. Soc. Mag. Reson. Med. 31 (2023)