1090

AUTOmated pulse SEQuence generation (AUTOSEQ) and neural network decoding for fast quantitative MR parameter measurement using continuous and simultaneous RF transmit and receive
Bo Zhu1,2,3, Jeremiah Liu4, Neha Koonjoo1,2,3, Bruce R. Rosen1,2, and Matthew S Rosen1,2,3

1Radiology, MGH Martinos Center for Biomedical Imaging, Charlestown, MA, United States, 2Radiology, Harvard Medical School, Boston, MA, United States, 3Physics, Harvard University, Cambridge, MA, United States, 4Biostatistics, Harvard University, CAMBRIDGE, MA, United States

Synopsis

Limited human intuition of the Bloch equations’ nonlinear dynamics, particularly over long periods of non-steady-state time evolution or in regimes such as off-resonance excitation, is an obstacle to fully exploiting the vast parameter space of potential MR pulse sequences. Our previous work introduced a computational graph approach to modeling the Bloch equations. In this work, we show the AUTOSEQ framework extended with a multilayer fully-connected neural network to perform fast quantitative MR parameter measurement. By employing continuous off-resonant excitation with simultaneous continuous receive, we demonstrate in simulated experiments the ability to quantify T1 and T2 parameters in a single TR.

Purpose

Limited human intuition of the Bloch equations’ nonlinear dynamics, particularly over long periods of non-steady-state time evolution or in regimes such as off-resonance excitation, is an obstacle to fully exploiting the vast parameter space of potential MR pulse sequences [1]. Model-based approaches such as optimal control and magnetic resonance fingerprinting [2,3] have been exploring computer-generated, non-intuitive sequences, but with typically limited roles as part of a larger canonical imaging sequence. Our previous work [4] introduced a computational graph approach to modeling the Bloch equations for efficient optimal control, and demonstrated generation of original pulse sequences with non-intuitive gradient waveforms to perform Fourier spatial encoding. In this work, we show the same core AUTOSEQ framework extended with a multilayer fully-connected neural network to perform fast quantitative MR parameter measurement. By employing continuous off-resonant excitation with simultaneous continuous receive, we demonstrate in simulated experiments the ability to quantify T1 and T2 parameters in a single TR, and expect this system to be extensible to other MR parameters of interest.

METHOD AND EXPERIMENTS

We model the Bloch equations with a discrete-time state-space model in the rotating frame, incorporating off-resonant RF excitation. This dynamic model is represented as a directed acyclic graph (DAG) (Figure 1A) with recurring discrete-time cells (similar to a recurrent neural network) in order to be efficiently optimized upon with autodifferentiation [5]. In this work, we chose to perform experiments of duration 1 second, with discrete timesteps of 1ms. The network was trained with simulated NMR samples on a grid of T1 from 100 to 1000 ms in 10ms increments, and T2 from 40 to 500 ms in 10ms increments. T2* was set to 50ms, and was implemented by summation of 16 isochromats experiencing various field in homogeneities. RF flip angle, phase, and off-resonance frequency for each timepoint n=1..1000 was initialized randomly at the start of training. The receive signal at each sample time point is concatenated and the signal vector is input into a four-layer fully-connected network with 4000 nodes per hidden layer (Figure 1B). This stage of the network is trained to map the signal vector to MR parameters, and is similar to the MR fingerprinting Deep Reconstruction Network (DRONE) [6] in that the universal approximation theorem is employed to perform a regression mapping of MR signal data to parameters. An important point to note is that the entire system – the pulse sequence Bloch simulation components and the regression network - is connected and differentiable and therefore able to be jointly optimized with stochastic gradient descent with a mean squared error loss with respect to the target MR parameters. The pulse sequence is optimized to provide the most relevant and discriminating signal to the regression network, which is optimized to accurately decode the MR parameters. In our simultaneous Tx-Rx setup, we transmit continuously during the experiment with the ADC is open (Figure 2D), and isolation of transmit and receive channels can be obtained by constraining the transmit RF frequency to be off-resonant over a certain frequency threshold (in our experiment, 100 Hz) through addition of a penalty in the optimization loss function (Figure 2C). After training, we validate our network on a set of T1 and T2 parameter pairs unseen during training. We show that a generated pulse sequence (Figure 2A-C) is able to perform T1 (Fig. 4A) and T2 (Fig. 4B) estimation. The reconstructed T1 and T2 values and their linear regressions showed excellent agreement with the ground truth. The discriminative ability of our system is highlighted in Fig. 3, which demonstrates improved signal separation with AUTOSEQ-generated pulse sequences compared with random pulse sequences. Furthermore, we demonstrate excellent noise robustness with a noise analysis using additive white gaussian noise (AWGN), showing low root mean squared error (RMSE) of estimated parameters across a wide range of SNR.

DISCUSSION

In addition to isolation of frequencies, decoupling of transmit and receive can be achieved through Tx-Rx circuitry and coil geometry design [8]. Previous parameter estimation approaches have demonstrated the advantage of crafting pulse sequences for particular timescales of parameter measurement [7]. Our method would allow for the automatic generation of such sequences, for arbitrary timescales, simply by selecting the appropriate training set or by weighting the loss function appropriately. Our future work includes other uses of more sophisticated loss functions that optimize over experimental considerations such as RF power, extension into other MR parameters such as diffusion coefficients, and ultimately into higher-dimensional applications such as measuring other spectroscopic parameters and imaging and with the inclusion of gradients.

Acknowledgements

B.Z. was supported by National Institutes of Health / National Institute of Biomedical Imaging and Bioengineering F32 Fellowship (EB022390).

References

[1] Lin, Yung-Ya, Natalia Lisitza, Sangdoo Ahn, and Warren S. Warren. "Resurrection of crushed magnetization and chaotic dynamics in solution NMR spectroscopy." Science 290, no. 5489 (2000): 118-121.[2] Rund, Armin, Christoph Stefan Aigner, Karl Kunisch, and Rudolf Stollberger. Magnetic Resonance RF pulse design by optimal control with physical constraints. IEEE, 2018. [3] Ma, Dan, Vikas Gulani, Nicole Seiberlich, Kecheng Liu, Jeffrey L. Sunshine, Jeffrey L. Duerk, and Mark A. Griswold. "Magnetic resonance fingerprinting." Nature 495, no. 7440 (2013): 187. [4] Zhu, Bo, Liu, Jeremiah, Koonjoo Neha, Rosen, R Bruce and Rosen S. Matthew. “AUTOmated pulse SEQuence generation (AUTOSEQ) using Bayesian reinforcement learning in an MRI physics simulation environment.” ISMRM workshop Machine Learning, March 2018 and in Proceedings of the 26th ISMRM Meeting & Exhibition in Paris, France 2018. [5] Baydin, Atılım Günes, et al. "Automatic Differentiation in Machine Learning: a Survey." Journal of Machine Learning Research 18 (2018): 1-43. [6] Cohen O, Zhu B, Rosen MS. MR fingerprinting Deep RecOnstruction Network (DRONE). Magn Reson Med. 2018;80:885–894. [7] Smith, Pieter ES, et al. "Ultrafast NMR T1 relaxation measurements: probing molecular properties in real time." ChemPhysChem 14.13 (2013): 3138-3145. [8] Sohn, Sung‐Min, et al. "In vivo MR imaging with simultaneous RF transmission and reception." Magnetic resonance in medicine 76.6 (2016): 1932-1938.

Figures

Fig. 1: Schematic illustration of AUTOSEQ including differentiable Bloch Simulator and MR parameter neural network decoder. A) Bloch simulation computational graph shown for one time-step. B) Transverse magnetization is summed across isochromats for each timepoint to obtain a signal vector, which is input to the fully-connected parameter decoding network with 4000 nodes for each of the hidden layers, and outputs estimated MR parameters (T1, T2, etc…). The pulse sequence and parameter decoding network are jointly optimized through backpropagation autodifferentiation.

Fig. 2: Simultaneous transmit and receive fast NMR parameter inference: example of AUTOSEQ-generated RF pulse sequence . RF flip angle (A), phase (B), and off-resonance excitation frequency (C) are freely varying parameters at each discrete time point (millisecond). To enable simultaneous transmit and receive, the off-resonance frequency is constrained to be greater than 100 Hz from the observe frequency. D) The ADC is on during the duration of the experiment during transmit, and the signal is then processed through the decoding network.

Fig. 3: Improved signal separation with AUTOSEQ-generated pulse sequences compared with random pulse sequences. A) Family of signal trajectories using AUTOSEQ-generated pulse sequence for iso-T2 of 100 ms and T1 between 150 and 750 ms. B) Family of signal trajectories using randomly-generated pulse sequence for the same iso-T2 of 100 ms and T1 between 150 and 750 ms. C) Mean deviation across time from T1=150 ms signal for AUTOSEQ- and 50 randomly- generated pulse sequences. Error bars show standard error of the mean.

Fig. 4: Estimated parameter values compared with ground truth values for T1 (A) and T2 (B). The red line indicates the identity line. The reconstructed T1 and T2 values and their linear regressions showed excellent agreement with the reference values.

Fig. 5: Noise analysis of AUTOSEQ parameter estimation for T1 (A) and T2 (B), showing root mean squared error (RMSE) for estimated T1 and T2 for signals with additive white gaussian noise at varying SNR levels. Even at lower SNR values of 10dB, we observe robust RMSE performance.

Proc. Intl. Soc. Mag. Reson. Med. 27 (2019)
1090