3709

U-JET: Preliminary results of a convolutional neural network approach for distortion-free image reconstruction of PROPELLER data
Jörn Huber1, Klaus Eickel1,2, and Matthias Günther1,2,3
1Fraunhofer Institute for Digital Medicine MEVIS, Bremen, Germany, 2mediri GmbH, Heidelberg, Germany, 3Faculty 1 (Physics/Electrical Engineering), University of Bremen, Bremen, Germany

Synopsis

Keywords: Machine Learning/Artificial Intelligence, Artifacts

Arterial Spin Labeling has great potential in clinics as a non-invasive alternative to Dynamic Contrast Enhanced imaging. However, motion sensitivity needs to be tackled by readout techniques such as 3D GRASE PROPELLER, which unfortunately shows a high sensitivity to geometric distortion. Analytical separation of motion and distortion effects is computationally demanding and might fail in some situations. To this aim, a U-NET based convolutional neural network approach is demonstrated which might overcome this limitation.

Introduction

Non-invasive Arterial Spin Labeling (ASL) perfusion imaging has the potential to become an alternative to invasive techniques such as DCE in clinical practice. However, ASL shows a high sensitivity to subject motion which is common in clinical reality1. Therefore, robust motion correction techniques are a must to pave the way of ASL into the clinics. It was recently shown, that pseudo-continuous ASL in combination with a 3D GRASE PROPELLER readout and an optimized reconstruction procedure allows a joint estimation and correction of motion and geometric distortion (3DGP-JET)2. However, computational demands were high and strong distortion arising e.g., from residual unsuppressed fat signal was likely to be missed by the algorithm. We propose that these limitations can be overcome by substituting the analytical JET algorithm by a U-NET3 based convolutional neural network which aims for artifact-free combination of individual PROPELLER blades (U-JET). To this aim, we demonstrate the application of U-JET on simulated PROPELLER data with different levels of geometric distortion.

Methods

Data generation
Training data were generated using Jemris4. Therefore, a spin-echo EPI PROPELLER sequence was designed, which shows the same in-plane distortion characteristics as other EPI-based PROPELLER sequences such as 3DGP. Fixed simulated sequence parameters were: acquisition matrix = 96x32, blades = 10 (golden-angle increment) and echo spacing = 0.7ms. Additional parameters were selected randomly in given ranges to introduce variations in contrast and object size: TE = [50-99] ms, TR = [3000-6000] ms, FoV = [250-500] mm2. For each simulation, one of 165 2D brain slice phantoms was randomly selected. Additional contrast variation was achieved by modulating the M0 value based on simulated signal intensities resulting from an initial saturation pulse with two randomly timed inversion pulses (assumed inflow time TI=3600 ms) as typically applied during ASL experiments. Finally, the off-resonance map (1.5 T) was modulated with a random factor (0 to 0.5) to introduce various levels of image distortion. Simulations were performed twice, with and without the off-resonance map. After gridding, blades without distortion were combined to form the target k-space data (cf. Fig. 1). Note that that the matrix size of gridded blades was cropped to 64x64 pixels to speed up the network training in this work. For each M0 + sequence parameters setup, the undistorted as well as the distorted blades together with the undistorted target reconstruction were sorted into training, test and validation sets based on an 80:10:10 split (cf. Fig. 2a). In total 1104 pairs (input+target) were split into 888 training, 106 validation and 110 test datasets. Each input as well as target dataset was normalized to values between 0 and 1.

Training of U-JET model
The model architecture as implemented in TensorFlow5 is demonstrated in Fig. 3 and follows the classical U-NET shape3. Complex-valued blades were split into real and imaginary parts which were subsequently distributed along the channel dimension to form a 64x64x2 matrix for each blade. Matrices from all 10 blades were concatenated to form a 64x64x20 input. After processed by U-JET, a 64x64x2 matrix was generated with real and imaginary parts spread along the third dimension, corresponding to the combined k-space. Optimization was accomplished using the Adam optimizer with a mean-squared error (MSE) loss function.

Results

Fig. 2b exemplarily shows the variation of images in the generated data pool, indicating different levels of geometric distortion, signal-to-noise ratio, field of view as well as image contrast. The evolution of the loss function for the training and validation dataset and the evolution of combined k-space data are shown in Fig. 4. Fig. 5 shows example images from the test dataset which were reconstructed using the original PROPELLER algorithm and the U-JET network. In addition, image quality metrics in terms of the structural similarity index (SSIM) and the Pearson-Cross-Correlation (PCC) are given.

Discussion

The U-JET model was able to visually reduce geometric distortion in the test data (cf. Fig. 5). While this is also evident from increased Pearson-Correlation-Coefficients (PCC) between target and predicted images, the structural similarity index (SSIM) is decreased, which could result from scaling differences between the images, being further investigated in future work. The generalizability of the network will also be further investigated by adding real MR data to the test dataset. Here, data from abdominal organs such as liver should be incoporated, because strong distortion arising from shifted fat signal prevents succesfull application of PROPELLER ASL in these regions so far and the proposed algorithm could overcome this limitation. We also propose to investigate different loss functions being more suited for k-space data than MSE. Note, that additional motion should not be simulated by rotating individual blades but needs to be incorporated into the simulation process to prevent violation of the physical properties of geometric distortion in combination with subject motion. Finally, this work can be seen as a promising starting point to investigate data-driven artifact-free reconstruction of 3D GRASE PROPELLER data to allow robust ASL imaging.

Conclusion

The presented U-JET allowed the visual reduction of distortion artifacts in reconstructed Spin-Echo EPI PROPELLER images. Quantitatively, this resulted in an increased Pearson-Correlation-Coeffecient between target and reconstruction when compard with the standard algorithm. Structural similiraty indices were however reduced, which will be further investigated.

Acknowledgements

No acknowledgement found.

References

1. Jalal B Andre, Brian W Bresnahan, Mahmud Mossa-Basha et al., Toward quantifying the prevalence, severity, and cost associated with patient motion during clinical MR examinations, J Am Coll Radiol. 2015 Jul;12(7):689-95

2. Jörn Huber, Daniel Christopher Hoinkiss, Matthias Günther., Joint estimation and correction of motion and geometric distortion in segmented arterial spin labeling, Magn Reson Med. 2022 Apr;87(4):1876-1885.

3. Ronneberger et al., U-Net: Convolutional Networks for Biomedical Image Segmentation. Medical Image Computing and Computer-Assisted Intervention -- MICCAI, 2015

4. Tony Stöcker, Kaveh Vahedipour, Daniel Pflugfelder et al., High-performance computing MRI simulations, Magn Reson Med. 2010 Jul;64(1):186-93

5. Abadi et al., TensorFlow: a system for large-scale machine learning, OSDI, 2016

Figures

Figure 1: Generation of simulated PROPELLER MR data with/without geometric distortion.

Figure 2: a.) Separation of simulated data into training, validation and test datasets; and b.) Exemplary results of image content in the generated data pool. Original refers to the standard PROPELLER reconstruction of data with geometric distortion.

Figure 3: Architecture of the U-JET model.

Figure 4: Training of the U-JET network. The upper part shows the evolution of training and validation loss functions. The lower part shows the exemplary evolution of the image combination process of a single example from the training data.

Figure 5: a.) Image reconstructions from test data using U-JET and the original PROPELLER algorithm. Target refers to the optimal target reconstruction. The left row shows examples without geometric distortion, the right row shows examples with geometric distortion; and b.) Calculated mean image quality metrics between all target images and U-JET/Standard reconstructions from the test dataset.

Proc. Intl. Soc. Mag. Reson. Med. 31 (2023)
3709
DOI: https://doi.org/10.58530/2023/3709