This paper explores the use of a deformable mesh (also known as control grid) structure for motion analysis and synthesis in an image sequence. In Part I, we focus on the synthesis problem, i.e., how to interpolate an image function given nodal positions and values and how to predict a present image frame from a reference one given nodal displacements between the two images. For this purpose, we review the fundamental theory and numerical techniques that have been developed in the finite element method for function approximation and mapping using a mesh structure. Specifically, we focus on i) the use of shape functions for node-based function interpolation and mapping and ii) the use of regular master elements to simplify numerical calculations involved in dealing with irregular mesh structures. In addition to a general introduction that is applicable to an arbitrary mesh structure, we also present specific results for triangular and quadrilateral mesh structures, which are the most useful two-dimensional (2-D) meshes. Finally, we describe how to apply the above results for motion compensated frame prediction and interpolation. In Part II, we will present algorithms developed for the analysis problem, including scene-adaptive mesh generation and nodal displacement estimation. It is shown that the concepts of shape functions and master elements are crucial for developing computationally efficient algorithms for both the analysis and synthesis problems.
|Number of pages
|IEEE Transactions on Circuits and Systems for Video Technology
|Published - 1996
ASJC Scopus subject areas
- Media Technology
- Electrical and Electronic Engineering