3937

Joint Non-Rigid Motion Estimation and Image Reconstruction via Sparse Blind Deconvolution
Frank Ong1 and Michael Lustig1

1Electrical Engineering and Computer Sciences, University of California, Berkeley, Berkeley, CA, United States

Synopsis

We propose a non-parametric method of jointly estimating non-rigid motion and the underlying image without the assumption of motion smoothness. We model non-rigid motion as local linear translation, which is equivalent to convolution with 1-sparse kernels. We then pose the non-rigid motion recovery problem as a sparse blind deconvolution problem. Our reconstruction results demonstrate that non-rigid motion can be well approximated as local translation motion using the proposed method. The proposed formulation can also be viewed as a generalization of locally low rank reconstruction.

Purpose

Dynamic MRI is inherently under-sampled and requires the incorporation of prior models for high spatial-temporal resolution image reconstruction. Low rank methods1-5 are effective in capturing MR dynamics, including contrast enhancement, cardiac perfusion and parameter mapping, yet large motion still poses problems. Various methods6-12 were proposed to incorporate motion estimation with iterative image reconstruction, yet often involve image registration or optical flow models that assume smoothness of the motion field. This assumption can lead to erroneous motion estimation when motion is not smooth.

In this work, we propose a non-parametric method of jointly estimating non-rigid motion and the underlying image without the assumption of motion smoothness. We model non-rigid motion as local linear translation, which is equivalent to convolution with 1-sparse kernels. We then pose the non-rigid motion recovery problem as a sparse blind deconvolution problem. The proposed method inherits the effectiveness of sparse methods and can also be viewed as a generalization of locally low rank reconstruction, which is robust to intensity variation.

Theory

To illustrate our proposed method, we first focus on the global linear translational model. Under this model, the image $$$x_t$$$ at time $$$t$$$ is a shifted version of an underlying image $$$l$$$, which can be represented as convolution with a 1-sparse motion kernel $$$r_t$$$, that is,

$$x_t = l \ast r_t$$

The location of the non-zero element in the 1-sparse kernel represents the amount of linear translation at time $$$t$$$. The size of the motion kernels determines the maximum linear translation possible, which is limited by physical constraints. Hence, recovering the sparse motion kernel allows us to extract motion information, without the assumption of motion smoothness. Figure 1 illustrates the global translational model.

To extend to non-rigid motion, we adopt the local translation approximation13 and model each local patch motion as local translation over time. Figure 2 shows the proposed decomposition applied on a reconstructed cardiac dataset with overlapping patches of size 16x16 with local motion kernels of size 16x16. Under the above motion model, the problem of recovering non-rigid motion becomes equivalent to recovering the local sparse motion kernels. Hence, we consider the following objective function for joint estimation of non-rigid motion and image:

$$f(l, r_t)=\sum_t \frac{1}{2}\|F_tS(l\ast r_t)-y_t\|_2^2+\frac{\lambda}{2}(\|l\|_2^2+\|r_t\|_1^2)$$

where $$$F_t$$$ is the Fourier sampling operator at time $$$t$$$, $$$S$$$ is the sensitivity operator, $$$y_t$$$ is the acquired k-space data at time $$$t$$$, $$$\lambda$$$ is the regularization parameter and $$$\ast$$$ denotes the local convolution operator. Alternating minimization can be used to reduce the objective function, with each subproblem being convex. (Figure 3)

We enforce sparsity within each motion kernel $$$r_t$$$ via a mixed $$$\ell 1$$$ norm within the kernel and $$$\ell 2$$$ norm across time, also known as the Elitist LASSO14. The $$$\ell 2$$$ norm is essential because it ensures that each motion kernel has at least one non-zero element14. The $$$\ell 1$$$ also leads to a more robust motion estimation because continuous motion can be represented as general sparse kernels instead of 1-sparse. Finally, the proposed formulation can be viewed as a generalization of locally low rank reconstruction15. In particular, when the motion kernel size is 1, the proposed formulation is equivalent to constraining the local patches to be of rank-1.

The proposed method leverages the effectiveness of existing sparse reconstruction methods to recover motion and inherents the robustness of sparse models in the sense that when .

Results

We applied our proposed method on a cardiac cine dataset obtained from the L+S code repository4. The data was acquired with a Turbo-FLASH on a 3T Siemens Trio scanner. The dataset has a matrix size of 256x256 with 24 time frames and 8 coils and was retrospectively under-sampled by a factor of 8.

Figure 4 shows the reconstructed result with overlapping patches of size 16x16 with local motion kernels of size 16x16, 30 outer iterations and with 30 inner iterations for each subproblem using FISTA16. Undersampling artifacts were mostly resolved in the reconstructed images and motion kernels were also recovered. Visually, the non-zero element location corresponds to the amount of local translation.

We also show that the proposed method can potentially be used on low spatial resolution image navigators to reliably extract motion information. Figure 5 shows the reconstructed result on the 32x32 low frequency kspace region with overlapping patches of size 4x4 with local motion kernels of size 4x4.

Discussion

The proposed method jointly estimates local linear translational motion and the underlying image without the assumption of motion smoothness. Our reconstruction results demonstrate that non-rigid motion can be well approximated and resolved using the proposed model.

Acknowledgements

We thank Wenwen Jiang and Joseph Cheng for insightful discussions.

References

[1] Z. P. Liang, “Spatiotemporal imaging with partially separable functions,” in Proc. IEEE Int. Symp. Biomed. Imag.: From Nano Macro, 2007, pp. 988–991.

[2] H. Pedersen, S. Kozerke, S. Ringgaard, K. Nehrke, and W. Y. Kim, “k-t PCA: Temporally constrained k-t BLAST reconstruction using principal component analysis,” Magn. Reson. Med., vol. 62, no. 3, pp. 706–716, Sep. 2009.

[3] Trzasko J, Manduca A, Borisch E. Local versus Global Low-rank Promotion in Dynamic MRI Series Reconstruction. Proc Int Symp Magn Reson in Medicine 2011; p. 4371.

[4] R. Otazo, E. Candes, and D. K. Sodickson, “Low-rank plus sparse matrix decomposition for accelerated dynamic MRI with separation of back- ground and dynamic components.” Magn. Reson. Med., vol. 73, no. 3, pp. 1125–1136, Mar. 2015.

[5] F. Ong and M. Lustig, “Beyond Low Rank + Sparse: Multiscale Low Rank Matrix Decomposition,” IEEE J. Sel. Top. Signal Process., vol. 10, no. 4, pp. 672–687, Jun. 2016.

[6] Batchelor PG, Atkinson D, Irarrazaval P, Hill DLG, Hajnal J, Larkman D. Matrix description of general motion correction applied to multishot images. Magnetic Resonance in Medicine 2005; 54:1273–1280.

[7] Odille F, Vuissoz PA, Marie PY, Felblinger J. Generalized reconstruction by inversion of coupled systems (grics) applied to free-breathing mri. Magnetic Resonance in Medicine 2008; 60:146–157.

[8] Cruz G, Atkinson D, Buerger C, Schaeffter T, Prieto C. Accelerated motion corrected three- dimensional abdominal mri using total variation regularized sense reconstruction. Magnetic Resonance in Medicine 2016; 75:1484–1498.

[9] High spatial and temporal resolution cardiac cine mri from retrospective reconstruction of data acquired in real time using motion correction and resorting. Magnetic Resonance in Medicine 2009; 62:1557– 1564.

[10] Xue H, Ding Y, Guetter C, Jolly MP, Guehring J, Zuehlsdorff S, Simonetti OP. Motion compensated magnetic resonance reconstruction using inverse-consistent deformable registration: Application to real-time cine imaging. Medical image computing and computer-assisted intervention 2011; 14:564–572.

[11] Asif MS, Hamilton L, Brummer M, Romberg J. Motion-adaptive spatio-temporal regularization for accelerated dynamic mri. Magnetic Resonance in Medicine 2013; 70:800–812.

[12] R. Otazo, T. Koesters, and E. Candes, “Motion-guided low-rank plus sparse (L+ S) reconstruction for free-breathing dynamic MRI,” presented at the Proceedings of ISMRM, 2014.

[13] Cheng JY, Alley MT, Cunningham CH, Vasanawala SS, Pauly JM, Lustig M. Nonrigid motion correction in 3d using autofocusing with localized linear translations. Magnetic Resonance in Medicine 2012; 68:1785–1797.

[14] M. Kowalski, “Sparse regression using mixed norms,” Applied and Computational Harmonic Analysis, 2009.

[15] J. Trzasko, A. Manduca, and E. Borisch, “Local versus global low-rank promotion in dynamic MRI series reconstruction,” ISMRM, 2011.

[16] A. Beck and M. Teboulle, “A Fast Iterative Shrinkage-Thresholding Algorithm for Linear Inverse Problems,” SIAM J. Imaging Sci., vol. 2, no. 1, pp. 183–202, Jan. 2009.

Figures

(Animated Gif) Illustration of the equivalence of translational motion and 1-sparse convolution. In particular, the non-zero position of the sparse kernel indicates the amount of linear translation.

(Animated Gif) Result of applying the proposed method on a fully-sampled numerical phantom. Non-rigid motion is locally approximated as linear translations, which can then be represented as local convolutions with sparse kernels. Note that the non-zero position of each kernel corresponds to the amount of linear translation of each local patch.

Conceptual illustration of the alternating minimization algorithm. The (overlapping) image patches and motion kernels are updated alternatively by fixing the other variable. Each update is a convex problem and can be solved efficiently.

(Animated Gif) Result of applying the proposed reconstruction method on a retrospectively under sampled cine dataset, recovering both the images and motion kernels.

(Animated Gif) Result of applying the proposed method on the 32 x 32 low resolution calibration region. The images are then upsampled via zero-padding in the Fourier domain by 8 for illustration. Note that the resulting motion kernels still captures the local translational motion information.

Proc. Intl. Soc. Mag. Reson. Med. 25 (2017)
3937