0052

Automated Sequence Design using Neural Architecture Search
Hongjun An1, Sooyeon Ji1, Sehong Oh2, Jiye Kim1, Dongmyung Shin1, and Jongho Lee1
1Department of Electrical and Computer Engineering, Seoul National University, Seoul, Korea, Republic of, 2Division of Biomedical Engineering, Hankuk University of Foreign Studies, Gyeonggi-do, Korea, Republic of

Synopsis

A new pulse sequence design method that requires no prior knowledge of MR physics or training dataset is proposed. This method utilizes neural architecture search, generating an optimal sequence for given properties (e.g., T2*, B1+) and target objectives. It successfully discovered FLAIR-like and spin-echo-like sequences. Furthermore, a less-intuitive sequence using three RF pulses was created when targeted for spin-echo. In an in-vivo experiment, this new sequence had almost identical contrasts and SNR with spin-echo (our SNR: 297.1±70.1; spin-echo SNR: 295.8±78.2) while utilizing 90% of RF energy of the spin-echo, suggesting a potential of the automated sequence design.

Introduction

Developing a sequence requires extensive knowledge of MR physics and, therefore, currently available sequences are limited by human intuition due to non-linearity in the Bloch equations and spin dynamics. Recently, AI-powered design methods have been proposed in various fields.1-3 Among them, automated sequence design methods have produced GRE-like sequences for target objects4-6 and performed optimization in existing sequences4. In this study, a new sequence design method is proposed using neural architecture search (NAS) to create pulse sequences without any prior knowledge of sequences or MR physics and without preparation of training dataset. In the current version, we confined our task to designing RF pulse parameters (e.g., number of pulses, flip angles, phases, delay between the pulses or readout).

Methods

Our method is designed to produce an optimal sequence for given tissue properties (M0, T1, T2, T2*), imaging properties (B1+, ΔB0), and target objectives. Hence, these properties are inputted to the Bloch simulator to generate MR signals. Using the signals, a loss function defined by the objective is calculated for optimization. Then the optimization process determines the sequence design (e.g., number of pulses, flip angles (α), phase (φ), duration after RF pulse (Δt1) or waiting duration (Δt2)) using NAS (Fig. 1). NAS was utilized to optimize a series of operations (i.e., sequence) by replacing a neural architecture and its weight parameters with a sequence design and its scan parameters, respectively. An example is given in Figure 1b where RF pulses and waiting duration are determined from search space and concatenated to generate a sequence. ProxylessNAS7 was utilized, which optimizes architecture parameters with back-propagation of the loss function.

[Simulation] Bloch simulator was implemented to consider relaxations, T2* effect, and magnetic field inhomogeneities. The simulator generated signals for a voxel. The T1 and T2 relaxation effects were applied during the idle and waiting durations. For the T2* effect, a number of isochromats were created, dephasing in a Lorentzian distribution. The B1+ factor was multiplied to the flip angle of the RF pulses. The B0 perturbation induced the phase shift of each isochromat.

[Experiments] To test our method, two experiments were performed to design a FLAIR-like sequence and a spin-echo-like sequence (Fig. 2).
Experiment 1: Null signal from cerebrospinal fluid (CSF) and maximize signals from white matter and gray matter.
Experiment 2: Maximize signal intensity while minimizing dependency of B1+ and B0 perturbation.
For both experiments, ranges of tissue properties were assumed as summarized in Figure 2 (M0 was 1).
The loss function contained signal intensity loss and RF energy loss. The signal intensity loss was defined as L2 loss between signal intensity and M0 for signal maximization, and between signal intensity and zero for nulling. The loss function for RF energy was designed to create a low RF energy sequence. The dependency of the perturbation was formulated as a derivative of signal intensity with respect to B1+ or B0 at B1+ = 1.0 and ΔB0 = 0 Hz. The repetition of the sequence was neglected assuming TR to be infinity. The maximum number of RF pulses was confined to 5. The minimum idle time between RFs or between RF and readout was set to 6.2 ms. RF pulses with less than 1° were discarded. In each experiment, a sequence was created four times and the best performing one was chosen as the final sequence.
The final sequences were compared to conventional sequences (Experiment 1 for FLAIR; Experiment 2 for CMPG spin-echo). In Experiment 2, in-vivo images using the final sequence and the spin-echo sequence were acquired from one subject: TR = 1,000 ms, FOV = 224 × 224 mm2, in-plane resolution = 1.8 × 1.8 mm2, slice thickness = 5 mm, and the number of slices = 16. The signal-to-noise ratio (SNR) of a region of interest (ROI) inside the brain and RF energy were compared.

Results

In Experiment 1, a FLAIR-like sequence was successfully generated (Fig. 3), revealing an inversion-like pulse at the beginning of the sequence then a long weighting duration for gray/white matter signal recovery and CSF signal suppression, which was followed by an excitation-like pulse. An unexpected 2° pulse existed between the two RF pulses but had little or no effect. The spin dynamics were also similar to FLAIR.
In Experiment 2, our method created two results: a spin-echo-like sequence and a less intuitive three RF pulse (12°-89°-168°) sequence behaving like spin-echo (Fig. 4; see spin dynamics). As shown in Figure 5, this new three-RF sequence produced identical contrasts and similar SNR with the spin-echo images (new sequence SNR: 297.1±70.1 vs. spin-echo SNR: 295.8±78.2). The new sequence had reduced RF energy (90% of the spin-echo), while taking a longer duration (18.6 ms vs. 12.4 ms).

Discussion and Conclusion

In this work, a novel automatic sequence design method requiring no prior knowledge or training data was proposed. The method automatically created sequences from the properties and target objectives. The results showed successful designs of FLAIR-like and spin-echo-like sequences. In addition, a less-intuitive spin-echo-like sequence using three RF pulses was generated with reduced RF energy. This study suggests a potential for automated sequence design that may explore possibilities beyond human intuition.

Acknowledgements

This work was supported by Creative-Pioneering Researchers Program through Seoul National University (SNU) and the National Research Foundation of Korea (NRF-2021R1A2B5B03002783).

References

[1] Shin, D., Kim, Y., Oh, C., An, H., Park, J., Kim, J., & Lee, J. (2021). Deep Reinforcement Learning Designed RadioFrequency Waveform in MRI. Nature Machine Intelligence, accepted.

[2] Sanchez-Lengeling, B., & Aspuru-Guzik, A. (2018). Inverse molecular design using machine learning: Generative models for matter engineering. Science, 361(6400), 360–365.

[3] Mirhoseini, A., Goldie, A., Yazgan, M., Jiang, J. W., Songhori, E., Wang, S., … & Dean, J. (2021). A graph placement methodology for fast chip design. Nature, 594(7862), 207–212.

[4] Loktyushin, A., Herz, K., Dang, N., Glang, F., Deshmane, A., Weinmüller, S., ... & Zaiss, M. (2021). MRzero‐Automated discovery of MRI sequences using supervised learning. Magnetic Resonance in Medicine, 86(2), 709-724.

[5] Zhu, B., Liu, J., Koonjoo, N., Rosen, B., & Rosen, M. (2018). AUTOmated pulse SEQuence generation (AUTOSEQ) using Bayesian reinforcement learning in an MRI physics simulation environment. In Proc. 26th Annu. Meeting ISMRM.

[6] Samuel, S. W. (2019). Using deep reinforcement learning to actively adaptively and autonomously control of a simulated MRI scanner. In Proc. 27th Annu. Meeting ISMRM

[7] Cai, H., Zhu, L., & Han, S. (2019). ProxylessNAS: Direct neural architecture search on target task and hardware. 7th International Conference on Learning Representations, ICLR 2019, 1–13.

Figures

Figure 1. (a) Overview of the proposed method. The properties and the target objectives are inputted to the sequence design machine, finding an optimal sequence automatically. (b) A design process of the proposed method using neural architecture search (NAS). After selecting sequence parameters using NAS, a Bloch simulator created a spin state and an MR signal using the properties. From the spin state, a loss function defined by the objectives is calculated to optimize the sequence.

Figure 2. Two experiments, one designing a FLAIR-like sequence and the other designing a spin-echo-like sequence, are tested. The objectives for the experiments and tissue properties assumed for the experiments are listed.

Figure 3. Results of Experiment 1. The proposed method successfully created a FLAIR-like sequence (i.e., an inversion-like pulse at the beginning of the sequence then a long weighting time for gray/white matter signal recovery and CSF signal suppression which is followed by an excitation-like pulse; unexpected 2° pulse exists between the two pulses) without any prior knowledge or training data. The spin dynamics were also similar to conventional FLAIR. In this setup, the nulling time for CSF was around 2.77 sec (T1 of CSF = 4000 ms; infinite TR), matching to our excitation time of 2.8 sec.

Figure 4. Result of Experiment 2. Our method designed two sequences: a spin-echo-like sequence and an almost spin-echo-like sequence with three RF pulses (12°-89°-168°). These two types of sequences are repeatedly designed with small variations in the same experimental setup. As demonstrated in the spin dynamics plots, both sequences refocused all spins at the readout. The arrows represent the isocromats that induce the dephasing for T2* decay.

Figure 5. In-vivo results of the conventional CPMG spin-echo sequence vs. the newly designed three RF sequence from Experiment 2. The new sequence generated almost identical contrasts and SNRs to the spin-echo results, while reducing RF energy to 90% of the spin-echo. Each SNR was calculated using the region in the white rectangles in c).

Proc. Intl. Soc. Mag. Reson. Med. 30 (2022)
0052
DOI: https://doi.org/10.58530/2022/0052