Evaluation of different descriptors for identifying similar video shots

In this paper, three techniques for video sequence retrieval which use statistical measures of color patterns in shots are proposed and compared. The first technique is based on a correlation of the MPEG7 Dominant Color Descriptor (DC) [6] as single characteristic feature of a shot. The second approach is to model color pattern distribution in a shot with a codebook, obtained by VQ (Vector Quantization) of the frame blocks composing the shot. The last one models the color pattern distribution using a GMM (Gaussian Mixture Model). Such descriptors are used to establish correspondence between non consecutive camera records through an appropriately designed similarity measure. As such, a new distance measure is used in the comparison between the shot descriptors, by extending the metric proposed in [9]. A comparison is made of the dissimilarity performance associated with each of the three proposed descriptors, demonstrating the superior results obtainable with the VQ based approach.