0694

Deep Learning based pseudo-CT estimation using ZTE and Dixon MR images for PET attenuation correction
Sandeep Kaushik1, Dattesh Shanbhag1, Andrew Leynes2, Hariharan Ravishankar1, Jaewon Yang2, Peder Larson2, Thomas Hope2, and Florian Wiesinger3

1GE Global Research, Bangalore, India, 2Department of Radiology and Biomedical Imaging, University of California, San Francisco, San Francisco, CA, United States, 3GE Global Research, Garching b. Munchen, Germany

Synopsis

Simultaneous PET/MR is now being adapted for clinical studies. Earlier methods of PET/MR-AC have considered all bones as a single entity irrespective of their density. In this work, we demonstrate using ZTE and Dixon LAVA-Flex MRI data, and deep learning framework, a continuous density pseudo-CT (pCT) image which combines soft tissue pCT (from Dixon LAVA-Flex) with a continuous density bone pCT from ZTE.

Introduction

Simultaneous PET/MR is now being adapted for clinical studies. Previously, Dixon based LAVA-Flex MR images provided good soft-tissue contrast to characterize MR based PET attenuation map (MRAC), but bone was ignored. Development of UTE and zero-echo time (ZTE) MR imaging methods [1] have now enabled bone depiction in MR images. Most of previous methods (atlas, segmentation, machine learning) for incorporating bone in MRAC workflow considered all bones in the FOV as a single entity; irrespective of their density. In this work, we demonstrate using ZTE and Dixon LAVA-Flex MRI data, and deep learning framework, a continuous density pseudo-CT (pCT) image which combines soft tissue pCT (from Dixon LAVA-Flex) with a continuous density bone pCT from ZTE. Additional advantages include: common bone depiction framework and computational efficiency for deployment using pre-trained convolutional neural network model.

Methods and Materials

Patient data: Patients who underwent PET/CT scan were scanned in a TOF GE Signa PET/MR scanner. ZTE (proton density weighted) and Dixon LAVA-Flex images were acquired for head and pelvis. LAVA-Flex: head and pelvis, two-point Dixon, body transmit/receive coil, TE/TR=1.15ms-2.3ms/4.05ms, FA=5°, FOV=500×500×312mm3, resolution = 1.95mm×1.95mm×2.6mm. Fat and water images were reconstructed from LAVA-Flex images and further processed to generate fat and water fraction images [2]. Head ZTE protocol was: FA=1°, BW=±62.5kHz, isotropic FOV=26.4cm, isotropic resolution=2.4mm. Pelvis ZTE protocol was: FA=0.6°, BW=±62.5kHz, isotropic FOV=34 cm, isotropic resolution = 2 mm. ZTE images were corrected for intensity variations using N4 algorithm. Image registration: CT images were registered to ZTE images using combination of rigid and diffeomorphic dense registration algorithms developed in ITK [ 4, 5]. Similarly, in-phase LAVA-Flex image was registered to ZTE image and transforms applied to water and fat images to warp them to ZTE space. Deep learning based bone segmentation: ZTE based bone segmentation was performed using an end-to-end trained model of fully convolutional networks [6] adapted in the U-Net architecture [7] and adapted from Mxnet library [9]. Deep learning (DL) model for bone segmentation was trained on ZTE images with corresponding bone mask label derived from co-registered CT image. The model operates on 2D slices and predicts a bone probability image of same size as input. Training of head model was performed on 560 slices from six patients , and pelvis model was trained on 1050 slices from seven patients . Trained model was tested on 680 slices from four patients (pelvis), and 440 slices from four patients (head). No contamination of training and test data occurred. DL bone probability map was binarized (threshold=0.6) to derive bone mask. We computed Dice overlap coefficient between CT bone mask and DL predicted bone mask to evaluate segmentation accuracy. Continuous cortical bone scaling: Cortical bone was obtained by thresholding normalized ZTE data (<0.9) within DL bone mask. Next, continuous bone value was assigned to cortical bone region by learning coefficients of linear regression of ZTE and corresponding CT in train datasets [8]. These coefficients were applied directly to test datasets to generate continuous bone scaling. pseudoCT conversion: Continuous valued soft-tissue pCT was derived from fat and water fraction images as described in [2]. Intra-body air regions in the head were segmented using Otsu threshold on N4-corrected-ZTE images. Continuous valued bone obtained from ZTE was pasted on soft-tissue pCT.

Result & Discussion

Fig.1 shows typical bone mask images predicted using DL trained model. Qualitative assessment (from Fig.1 and 2) suggests that DL based bone segmentation maintained the shape of bone structures in skull, pelvis, femur, and vertebrae region. Critically, it does not include air-pockets, which is significant since air-pockets have overlapping signal intensity profile with cortical bone. DL bone mask is observed to be slightly over-segmented compared to CT bone (Lower Dice of ~0.71-0.80 (pelvis), and ~0.82-0.86 (head)). However, over-segmentation does not affect pCT fidelity since ZTE data is used for further refinement of bone mask to extract cortical bone (Fig.3). Overall, we notice that cortical bone obtained from DL and ZTE thresholding matches very well to CT cortical bone (Fig.3, pelvis shown). Fig.4 shows that the proposed continuous density pseudoCT generated from Lava-Flex and ZTE matches gold standard CT well.

Conclusion

We have presented a transformation model for generating pCT images from ZTE and Dixon Lava-Flex MR images. We have demonstrated the bone values using model predicted pCT is comparable with bone from true CT image.

Acknowledgements

No acknowledgement found.

References

[1]. F. Wiesinger, et.al., MRM, 2014

[2]. D.D. Shanbhag, et.al., ISMRM, 2012

[3]. T. Huynh, et.al., IEEE TMI, 2015-0306

[4]. B.B Avants, et. al., Penn Image Computing and Science Laboratory, 2009

[5]. H. Patel, et al., 36th Ger. Conf. Pattern Recognit, 2014

[6]. Long, J., et al., CVPR, 2015

[7]. Ronneberger, O., et al., MICCAI, 2015

[8]. F. Wiesinger, et.al., ISMRM, 2015

[9]. Chen, T., et al, arXiv preprint arXiv:1512.01274, 2015

Figures

Fig.1: Pelvis pseudo-CT images generated using the trained model. Head-P01, Pelvis-P13

Fig.2: 3D rendered pelvis bone from CT and ZTE. Head-P01, Pelvis-P13

Tab.1: Dice coefficient of predicted bone mask vs. CT reference bone mask.

Fig.3: Various steps involved from using DL based binary mask to cortical bone mask are shown. The results are compared to gold standard CT cortical mask.

Fig.4: Comparison of predicted pseudoCT image against reference CT image(Left). The soft tissue separation in pseudoCT is obtained from the fat and water Dixon images (Middle), and the continuous bone mask is computed from the ZTE image to form final pseudoCT with continous bone (Right).

Proc. Intl. Soc. Mag. Reson. Med. 25 (2017)
0694