Automatic video object segmentation using volume growing and hierarchical clustering

Fatih Porikli, Yao Wang

Research output: Contribution to journalArticle

Abstract

We introduce an automatic segmentation framework that blends the advantages of color-, texture-, shape-, and motion-based segmentation methods in a computationally feasible way. A spatiotemporal data structure is first constructed for each group of video frames, in which each pixel is assigned a feature vector based on low-level visual information. Then, the smallest homogeneous components, so-called volumes, are expanded from selected marker points using an adaptive, three-dimensional, centroid-linkage method. Self descriptors that characterize each volume and relational descriptors that capture the mutual properties between pairs of volumes are determined by evaluating the boundary, trajectory, and motion of the volumes. These descriptors are used to measure the similarity between volumes based on which volumes are further grouped into objects. A fine-to-coarse clustering algorithm yields a multiresolution object tree representation as an output of the segmentation.

Original languageEnglish (US)
Pages (from-to)814-832
Number of pages19
JournalEurasip Journal on Applied Signal Processing
Volume2004
Issue number6
DOIs
StatePublished - Jun 1 2004

Keywords

  • Centroid linkage
  • Color similarity
  • Object detection
  • Video segmentation

ASJC Scopus subject areas

  • Signal Processing
  • Hardware and Architecture
  • Electrical and Electronic Engineering

Fingerprint Dive into the research topics of 'Automatic video object segmentation using volume growing and hierarchical clustering'. Together they form a unique fingerprint.

Cite this