4249

Neural network based denoising of high temporal resolution cine images for tumor tracking in MR-guided radiotherapy
Florian Friedrich1,2, Juliane Hörner-Rieber3, Peter Bachert1,2, Mark E. Ladd1,2,4, and Benjamin R. Knowles1
1Medical Physics in Radiology, German Cancer Research Center (DKFZ), Heidelberg, Germany, 2Department of Physics and Astronomy, Heidelberg University, Heidelberg, Germany, 3Department of Radiation Oncology, University Hospital of Heidelberg, Heidelberg, Germany, 4Faculty of Medicine, Heidelberg University, Heidelberg, Germany

Synopsis

MR-linac systems allow for real-time tumor position updates. Higher temporal resolution imaging through k-space undersampling allows for an increased number of position updates, however iterative reconstructions may negate the decrease in acquisition time and undersampling artifacts may impact tracking stability.

In this study a fast method to denoise and suppress image artifact using a U-net is presented. Undersampled Cartesian and radial cine images were acquired from a patient with a liver tumor on an MR-linac. Tumor tracking stability was assessed. Denoising was found to improve tracking stability and has potential in high temporal resolution cine imaging on MR-linac systems.

Introduction

Hybrid MR-linac systems allow for the direct tumor visualization using real-time cine MRI during radiotherapy. Tumor motion can be compensated for by tracking the tumor contour and gating radiation delivery when the tumor moves out of the target region. For this purpose fast imaging in combination with robust tumor tracking is essential. Faster image acquisition can be achieved through sub-Nyquist sampling of k-space data, however this can lead to prolonged reconstruction times which is unsuitable for real-time tracking. In this work, the temporal resolution of a cine sequence is increased by undersampling radial and Cartesian acquisitions. To compensate for the resultant undersampling artifacts, a U-net was used for denoising. In addition, a second U-net was employed for tumor tracking.

Methods

All images were acquired on a low-field MR-linac (MRIdian Linac System, ViewRay Inc., Cleveland, Ohio, USA). One healthy volunteer was measured in order to optimize network parameters as well as one patient undergoing treatment for liver cancer for which the denoising method could be tested and tracking performance evaluated.

A bSSFP sequence was implemented to maximize signal-to-noise ratio [1] with the following parameters: voxel size = 2.3x2.3x7.5 mm³, field of view = 300x300 mm², TR/TE = 3.14 ms / 1.57 ms, flip angle = 90°. Both radial and Cartesian k-space read-out schemes were implemented. Radial scheme used the 10th tiny golden angle increment between spokes [2], and were reconstructed using both an adjoint NUFFT [3] as well as iterative SENSE [4]. Undersampled Cartesian images were reconstructed by a zero-filled inverse FFT as well as GRAPPA [5] using five calibration lines.

All reconstructions were performed with varying undersampling factors, performed retrospectively, in order to assess image quality. Images were reconstructed using 128 k-space lines (reference images, 2.5 fps), 30 lines (10.6 fps), 20 lines (15.9 fps) and 10 lines (31.8 fps) for both Cartesian and radial data. From the reference images, 50 tumor contours were manually created. A 5-fold cross-validation was used to analyze 200 images in total.

Denoising of undersampled radial and Cartesian images was performed using a neural network with the U-net architecture [6]. The U-net was trained over 100 epochs with 50 pairs of images: one image with 128 spokes and lines, respectively, and the corresponding undersampled image.

The tumor was tracked in the images with and without denoising using a second U-net network with the same architecture. This U-net was trained with image augmentation over 150 epochs with 10 images and their manual tumor contours.

Images were compared to the reference images quantitatively using a normalized cross-correlation. The tracking was evaluated using two metrics: dice coefficient and the Hausdorff distance.

Results

Denoising performance increased with the size of the training data set (Fig. 1). Using 10 training images was sufficient to increase image quality and suppress noise and streaking artifacts, however significant blurring occurred. With 50 training images, blurring is reduced such that vessels within the liver are clearly visible.

On a visual inspection of the images (Fig. 2), it can be seen that denoising strongly improves image appearance compared to images reconstructed with inverse FFT or GRAPPA, even in the case of high undersampling factors. This is also demonstrated quantitatively, on observation of the normalized cross-correlation values. For radial images (Fig. 3), denoising is also highly effective and a similar trend to that of the Cartesian images can be observed.

Tracking metrics are shown in Figs. 4 and 5 for Cartesian and radial image data. It can be seen that for highly undersampled data, image denoising improved tracking stability. In this case, Cartesian-acquired images can be seen to have improved tracking metrics compared to radially-acquired images.

Discussion

In this study, the Cartesian-acquired images tended towards improved denoising, artifact reduction and tracking performance compared to the radially-acquired images. One reasoning for this is that the radial data were acquired with a golden-angle increment, leading to a varying appearance of undersampling artifacts between frames in the image time series. In this case the U-net data training may have had difficulty in learning these artifacts, in comparison to the static appearance of the Cartesian undersampling artifacts.

In terms of tumor tracking, it should be acknowledged that the U-net based tracking method was surprisingly effective at tumor tracking in images without denoising, in which very few features were visible in the images. However, denoising improved the stability of the tumor tracking in the case of high undersampling factors. A larger patient cohort containing different tumor shapes and contrasts, and a variety of breathing patterns would be required to extract the potential trends in these data.

The use of parallel imaging in the denoising process was found to have only a small impact on tumor tracking. As a single frame of denoised data can be processed within 53 ms, after learning, on standard desktop hardware, this allows for an online implementation of this technique.

Conclusion

Image denoising using U-net allows for a fast, potentially online, method for reducing noise and the appearance of undersampling artifacts in highly undersampled cine images used in tumor tracking in MR-guided radiotherapy.

Acknowledgements

No acknowledgement found.

References

1. Scheffler K, Lehnhardt S. Principles and applications of balanced SSFP techniques. Eur Radiol. 2003;13(11):2409-2418. doi:10.1007/s00330-003-1957-x
2. Wundrak S, Paul J, Ulrici J, et al. Golden ratio sparse MRI using tiny golden angles. Magn Reson Med. 2016;75(6):2372-2378.
3. Fessler JA, Sutton BP. Nonuniform fast Fourier transforms using min-max interpolation. IEEE Trans Signal Process. 2003;51(2):560-574.
4. Pruessmann KP, Weiger M, Scheidegger MB, Boesiger P. SENSE: Sensitivity Encoding for Fast MRI. Magnetic Resonance in Medicine. 1999;42:952-962.
5. Griswold MA, Jakob PM, Heidemann RM, et al. Generalized Autocalibrating Partially Parallel Acquisitions (GRAPPA). Magnetic Resonance in Medicine. 2002;47:1202-1210.
6. Ronneberger O, Fischer P, Brox T. U-net: Convolutional networks for biomedical image segmentation. Med Image Comput Comput Interv. 2015;9351:234-241.

Figures

Figure 1: Denoising quality of NUFFT images with 30 spokes of a healthy volunteer for training data sets between 10 and 100 image pairs. The difference to the reference image with 128 spokes is visualized below the images and measured by normalized cross-correlation (values within the images).

Figure 2: Denoising of undersampled Cartesian images of a liver tumor (arrow).

Figure 3: Denoising of undersampled radial images of a liver tumor (arrow).

Figure 4: Tumor tracking of the Cartesian images with and without denoising. Numbers bellow each boxplot represent mean values. Numbers at the top counts number of frames out of 200, in which the tumor was found.

Figure 5: Tumor tracking of the radial images with and without denoising. Numbers bellow each boxplot represent mean values. Numbers at the top counts number of frames out of 200, in which the tumor was found.

Proc. Intl. Soc. Mag. Reson. Med. 29 (2021)
4249