Cookies on this website

We use cookies to ensure that we give you the best experience on our website. If you click 'Accept all cookies' we'll assume that you are happy to receive all cookies and you won't see this message again. If you click 'Reject all non-essential cookies' only necessary cookies providing core functionality such as security, network management, and accessibility will be enabled. Click 'Find out more' for information on how to change your cookie settings.

We propose a multiscale spatio-temporal graph convolutional network (MST-GCN) approach to learn the left ventricular (LV) motion patterns from cardiac MR image sequences. The MST-GCN follows an encoder-decoder framework. The encoder uses a sequence of multiscale graph computation units (MGCUs). The myocardial geometry is represented as a graph. The network models the internal relations of the graph nodes via feature extraction at different scales and fuses the feature across scales to form a global representation of the input cardiac motion. Based on this, the decoder employs a graph-based gated recurrent unit (G-GRU) to predict future cardiac motion. We show that the MST-GCN can automatically quantify the spatio-temporal patterns in cardiac MR that characterise cardiac motion. Experiments are performed on mid-ventricular short-axis view cardiac MR image sequence from the UK Biobank dataset. We compare the performance of cardiac motion prediction of the proposed method with ten different architectures and parameter settings. Experiments show that the proposed method inputting node positions and node velocities with multiscale graphs achieves the best performance with a mean squared error of 0.25 pixel between the ground truth node locations and our prediction. We also show that the proposed method can estimate a number of motion-related metrics, including endocardial radii, thickness and strain which are useful for regional LV function assessment.

Original publication




Conference paper



Publication Date



264 - 272


cardiac MR, FFR, motion analysis, spatio-temporal graph convolutional networks