2663

Probing the Feasibility and Performance of Super-Resolution Head and Neck MRA Using Deep Machine Learning
Ioannis Koktzoglou1,2, Rong Huang1, William J Ankenbrandt1,2, Matthew T Walker1,2, and Robert R Edelman1,3
1Radiology, NorthShore University HealthSystem, Evanston, IL, United States, 2University of Chicago Pritzker School of Medicine, Chicago, IL, United States, 3Northwestern University Feinberg School of Medicine, Chicago, IL, United States

Synopsis

Deep machine learning approaches offer the potential for improved super-resolution (SR) reconstruction which could be useful in many clinical applications. Patients with suspected stroke often undergo MRI, which often includes magnetic resonance angiography (MRA) of the head and neck arteries with scan times of ≈10 to 15 minutes using standard nonenhanced methods. With the aim of shortening scan times, we evaluated the feasibility and performance of four deep neural network (DNN)-based SR reconstructions for restoring the image quality and spatial resolution of thin slab stack-of-stars quiescent interval slice-selective (QISS) head and neck MRA with degraded slice resolution.

Introduction

Vascular evaluation of the head and neck remains a key component in the diagnostic evaluation of patients presenting with suspected stroke.1 Recently, 3D thin-slab stack-of-stars quiescent interval slice-selective (3D tsSOS-QISS) MRA has been shown to provide high spatial resolution of the entire neck and Circle of Willis in ≈7 minutes with better image quality than time-of-flight (TOF) MRA.2 Nonetheless, further reduction of scan time would be desirable to improve patient comfort, reduce motion artifacts, and hasten diagnostic evaluation. Deep neural network (DNN)-based methods have recently found uses in numerous medical imaging applications, including for image reconstruction and restoration in accelerated MRI.3 We hypothesized that DNN-based SR reconstruction could be applied to 3D tsSOS-QISS head and neck MRA to allow the acquisition of a reduced number of thicker slices, thereby shortening scan time while preserving spatial resolution.

Methods

General: This study was approved by our institutional review board and all participants (n=8, 7 healthy volunteers, 1 patient with carotid disease) provided written informed consent. Imaging was done using a prototype 3D tsSOS-QISS MRA sequence on a 3T MRI system (MAGNETOM Skyrafit, Siemens Healthineers, Erlangen) equipped with a 20-channel head and neck coil.

3D tsSOS-QISS Protocol: Based on prior work2, prototype 3D tsSOS-QISS MRA of the head and neck was acquired with the following parameters: 0.86×0.86×1.30mm3 spatial resolution interpolated to 0.43×0.43×0.65mm3, axial coverage of 288.6mm, scan time 6min 39s, 300mm field of view, 352 acquisition matrix (704 reconstruction matrix after zero filling interpolation), fast low-angle shot readout with TR 9.9ms and TEs of 1.6ms, 3.7ms, and 5.7ms which were combined using a root mean square procedure2, QISS TR/QI of 1500/583ms. Acquired high-resolution (HR) volumes were considered as ground truth, while the 2-, 3-, 4-, 5-, and 6-fold lowered-resolution (LR) volumes were generated by Fourier transforming the HR data sets along the slice-direction, zeroing the most peripheral spatial frequencies along the slice direction, and inverse Fourier transformation back to the image domain.

DNN Architectures: Four 2D patch/3D block-based deep neural network (DNN) models were tested: (1) 2D U-Net and (2) 3D U-Net4, and (3) 2D and (4) 3D networks consisting of serial convolutions and a residual connection (SCRC)5. These four DNNs, hereafter referred to as 2D U-Net, 3D U-Net, 2D SCRC, and 3D SCRC, respectively, are summarized in Figure 1.

Network Training: DNN training was done using leave-one-out cross-validation, an adaptive moment estimation optimizer, a mean squared error loss function, validation split of 20%, and early stopping based on validation loss. Typical training times for the 2D U-Net, 3D U-Net, 2D SCRC and 3D SCRC DNNs on a commodity graphics processing unit were ≈2 min (9 epochs), 9 min (7 epochs), 5 min (9 epochs) and 60 min (9 epochs), respectively.

Image Analysis: Images were analyzed quantitatively using Dice similarity coefficients (DSC) calculated for the intracranial and extracranial arteries, as well as through structural similarity index (SSIM), normalized root mean squared error (NRMSE), arterial sharpness, and arterial diameter measurements made in the bilateral M1 middle cerebral arteries. Forced choice scoring of randomized coronal maximum intensity projection (MIP) images (best DNN SR method versus LR input) was done by two experienced neuroradiologists.

Results

Figure 2 shows the image quality obtained with the 3D SCRC SR resolution technique with respect to the LR input volumes, and the target high-resolution output volume. With respect to the LR volume, 3D SCRC SR improved vessel conspicuity and sharpness in the slice-encoding (i.e. axial) direction, which mimicked that of the target volume for all tested resolution reduction factors.

DSC measures of agreement in arterial anatomy portrayed in the SR-reconstructed and the ground truth volumes are shown in Figure 3. Arterial SSIM, NRMSE, diameter and sharpness metrics are summarized in Figure 4. All four quantitative metrics improved with application of the DNN SR techniques (Friedman, P<0.05), with arterial DSC, SSIM and sharpness values increasing, and with arterial NRMSE and diameter values decreasing with respect to those obtained from the LR volumes. Generally, 3D DNN outperformed 2D DNN SR reconstructions, while SCRC DNNs outperformed U-Net DNNs of the same dimensionality. The 3D SCRC DNN method provided the largest overall DSC values. The 3D DNNs provided median SSIM values of ≥0.9 and retained HR-levels of image sharpness for reduction factors of up to 4.

MR angiograms obtained with the best performing 3D SCRC SR DNN were consistently preferred by neuroradiologists over those obtained from the input LR volumes.

Discussion and Conclusion

We probed the capability of four DNN-based SR methods to improve spatial resolution in 3D tsSOS-QISS MRA configured with up to 6-fold degraded spatial resolution in the axial direction. We found that 2D and 3D DNN-based approaches restored image spatial resolution and appearance for resolution reduction factors up to 2 intracranially and 4 extracranially, according to multiple quantitative metrics including arterial DSC, SSIM, NRMSE, sharpness and diameter. In conclusion, DNN-based SR reconstruction can improve apparent spatial resolution in the axial direction and holds promise for substantially shortening the acquisition times of nonenhanced 3D tsSOS-QISS MRA.

Acknowledgements

FUNDING SOURCE: NIH grant R01 EB027475

References

1. Powers WJ, et al. Stroke. 2019 Dec;50(12):e344-e418. doi: 10.1161/STR.0000000000000211. Epub 2019 Oct 30.
2. Choy G, et al. Radiology. 2018 Aug;288(2):318-328. doi: 10.1148/radiol.2018171820. Epub 2018 Jun 26.
3. Koktzoglou I, et al. Magn Reson Med. 2020 Dec;84(6):3316-3324. doi: 10.1002/mrm.28339. Epub 2020 Jun 10.
4. Ronneberger O, Fischer P, Brox T. U-Net: Convolutional Networks for Biomedical Image Segmentation. ArXiv150504597 Cs 2015.
5. Chaudhari AS, et al. Magn Reson Med. 2018 Nov;80(5):2139-2154. doi: 10.1002/mrm.27178. Epub 2018 Mar 26.

Figures

Figure 1. Architectures of the deep neural networks used for super-resolution reconstruction. ReLU = rectified linear unit. Training batch sizes for networks (a) through (d) were 400, 80, 400 and 20, whereas the number of trainable parameters for networks were 540,073, 436,521, 185,857 and 556,801, respectively.

Figure 2. Coronal MIP 3D tsSOS-QISS MRA images showing the impact of 3D SCRC SR DNN reconstruction on image quality for 2- to 4-fold reduced of axial spatial resolution with respect to ground truth data (left-most column) and input lower resolution (LR) data (right-most upper panels). Insets show magnified views of the right middle cerebral artery. Note the markedly improved image quality and spatial resolution of the 3D SCRC SR DNN with respect to input LR volumes.

Figure 3. Boxplots showing intracranial and extracranial DSCs obtained with the SR DNNs for various spatial resolution reduction factors. 3D DNN SR reconstructions provided the largest DSCs, with the 3D SCRC DNN providing the largest DSCs. Horizontal bars indicate significant differences (P<0.05, Wilcoxon signed-rank tests) between reconstruction techniques. Numbers are medians; bold red values indicate DNNs providing DSCs≥0.9. Horizontal dashed lines show the minimum DSC adequacy threshold of 0.9. DSC = Dice similarity coefficient.

Figure 4. Bar plots of quantitative measures obtained with the DNN SR reconstructions for various resolution reduction factors. Horizontal bars indicate significant differences (P<0.05, Bonferroni-corrected Wilcoxon signed-rank tests) between reconstructions. Numbers are medians; bold red values highlight DNNs providing SSIMs≥0.9, significantly reduced NRMSEs differing from those of the LR volumes, and arterial sharpness and diameter measurements not significantly differing from those of the HR volumes. Dashed lines indicate the minimum SSIM adequacy threshold of 0.9.

Proc. Intl. Soc. Mag. Reson. Med. 29 (2021)
2663